-- Logs begin at Thu 2022-06-23 10:03:28 UTC, end at Thu 2022-06-23 11:17:56 UTC. -- Jun 23 10:41:25.184511 dv-cinder-846146-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 10:41:25.194132 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 10:41:25 2022] *** Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: nodename: dv-cinder-846146-4-iscsi Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: machine: x86_64 Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: clock source: unix Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: pcre jit disabled Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: detected number of CPU cores: 4 Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: current working directory: / Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: detected binary path: /usr/bin/uwsgi-core Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: your processes number limit is 47680 Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: your memory page size is 4096 bytes Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: detected max file descriptor number: 2048 Jun 23 10:41:25.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: lock engine: pthread robust mutexes Jun 23 10:41:25.197126 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: thunder lock: enabled Jun 23 10:41:25.197126 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 10:41:25.197126 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 10:41:25.240636 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: Python main interpreter initialized at 0x5617274e09c0 Jun 23 10:41:25.240636 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: python threads support enabled Jun 23 10:41:25.240636 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: your server socket listen backlog is limited to 100 connections Jun 23 10:41:25.240636 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: your mercy for graceful operations on workers is 90 seconds Jun 23 10:41:25.241072 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 10:41:25.241072 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: *** Operational MODE: preforking *** Jun 23 10:41:25.241336 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: *** uWSGI is running in multiple interpreter mode *** Jun 23 10:41:25.241336 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: spawned uWSGI master process (pid: 114938) Jun 23 10:41:25.241555 dv-cinder-846146-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 10:41:25.246377 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: spawned uWSGI worker 1 (pid: 114939, cores: 1) Jun 23 10:41:25.246377 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: spawned uWSGI worker 2 (pid: 114940, cores: 1) Jun 23 10:41:25.246377 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 10:41:25.913067 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 10:41:25.916973 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 10:41:27.061618 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:41:27.061618 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: from cryptography.utils import int_from_bytes Jun 23 10:41:27.062237 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:41:27.062237 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: from cryptography.utils import int_from_bytes Jun 23 10:41:27.062409 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:41:27.062409 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: from cryptography.utils import int_from_bytes Jun 23 10:41:27.062409 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:41:27.062409 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: from cryptography.utils import int_from_bytes Jun 23 10:41:29.590976 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:41:29.591580 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:41:29.591742 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:41:29.592099 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:41:29.592345 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:41:29.592728 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.593049 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.593369 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.593681 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.594004 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.594103 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:41:29.594501 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:41:29.594587 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.594684 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.594845 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:41:29.594934 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.595213 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:41:29.595325 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.595457 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:41:29.595611 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.595782 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.595899 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.596109 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-4-iscsi {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.596246 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.596420 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.596527 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.596725 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.596825 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.597029 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.597138 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.597349 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.597492 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.597627 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.597753 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.597941 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.598102 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.598235 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.598397 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.598533 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.598744 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.598899 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.599147 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-4-iscsi {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.599305 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.600007 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.600137 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.600344 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.600614 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.600752 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.600919 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.601101 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.601227 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.601400 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.601547 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.601729 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.601871 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.601997 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.602115 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.602301 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.602627 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.602799 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.602940 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.603085 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-4-iscsi {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.603216 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.603350 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.603517 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.603642 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.603847 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.603997 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.604142 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.604312 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.604456 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.604602 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.604731 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.604915 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.605087 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.605219 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.605348 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.605533 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.605675 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.605913 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.606109 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-4-iscsi {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.606365 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.606549 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.606723 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.606904 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.607073 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.607254 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.607428 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.607610 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.607733 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.607911 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.608034 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.608182 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.608307 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.608444 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.608628 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.608760 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.608903 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.609044 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.609167 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.609167 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.609412 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.609534 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.609674 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.609796 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.609927 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.610062 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.610183 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.610338 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.610518 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.610640 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.610765 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.610886 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.611020 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.611157 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.611280 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.611401 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.611524 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.611650 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.611783 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.611923 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.612053 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.612241 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.612366 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.612489 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.612619 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.612751 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.612870 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.613037 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.613161 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.613338 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.613476 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.613656 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.613785 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.613948 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.614069 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.614259 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.614440 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.614582 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.614712 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.614941 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.615139 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.615419 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.615547 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.615817 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.615943 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.616051 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.616157 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.616357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.616489 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.616689 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.616808 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.617004 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.617122 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.617309 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.617430 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.617622 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.617752 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.617938 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.618055 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.618240 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.618424 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.618549 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.618690 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.618857 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.619036 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.619178 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.619309 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.619476 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.619606 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.619772 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.619906 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.620028 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.620149 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.620299 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.620435 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.620599 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.620733 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.620911 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.621212 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.621335 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.621512 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.621651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.621811 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.621935 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.622106 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.622243 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.622498 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.622656 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.622824 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.622960 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.623081 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.623218 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.623347 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.623477 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.623607 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.623728 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.623849 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.623967 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.624145 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.624269 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.624441 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.624564 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.624737 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.624858 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.625030 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.625154 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.625340 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.625481 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.625644 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.625788 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.625922 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.626043 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.626220 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.626387 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.626584 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.626708 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.626914 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.627036 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.627158 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.627289 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.627410 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.627530 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.627699 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.627823 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.628002 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.628170 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.628301 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.628424 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.628598 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.628723 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.628897 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.629038 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.629221 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.629352 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.629475 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.629606 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.629771 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.629903 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.630070 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.630205 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.630380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.631062 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.631317 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.631406 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.631564 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.631717 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.631860 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.632051 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.632202 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.632338 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.632485 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.632628 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.632767 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.632910 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.633062 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.633211 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.633345 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.633491 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.633628 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.633784 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.633922 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.634097 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.634188 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.634423 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.634574 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.634726 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.634803 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.635024 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.635119 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.635325 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.635582 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.635727 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.635865 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.636008 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.636156 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.636246 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.636322 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.636479 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.636640 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.636796 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.636944 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.637085 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.637223 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.637386 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.637530 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.637692 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.637838 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.637995 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.638127 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.638279 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.638436 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.638622 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:41:29.638766 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.638955 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.639055 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.639289 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.639439 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.639625 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.639758 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.639936 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.640065 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.640256 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.640385 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.640569 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.640722 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.640874 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.641006 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.641180 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.641320 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.641483 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.641620 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.641783 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.641924 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.642097 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.642228 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.642430 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.642528 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.642739 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.642875 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.643075 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.643209 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.643412 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.643553 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.643721 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.643854 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.644040 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.644181 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.644357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.644491 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.644665 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.644850 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.644978 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.645117 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.645255 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.645390 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.645561 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.645732 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.645864 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.646006 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.646239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.646881 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.647109 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.647194 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.647510 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.647662 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.647802 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.647944 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.648102 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.648236 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.648393 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.648536 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.648700 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.648838 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.649005 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.649156 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.649396 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.649529 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.649668 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.649798 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.649928 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.650065 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.650206 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.650290 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.650546 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.650686 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.650817 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.650947 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.651110 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.651253 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.651429 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.651567 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.651698 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.651846 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.651978 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.652117 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.652282 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.652422 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.652581 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.652681 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.652897 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.653036 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.653207 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.653340 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.653507 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.653652 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.653813 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.653953 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.654119 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.654257 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.654445 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.654592 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.654730 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.654870 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.655035 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.655190 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.655335 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.655471 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.655614 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.655750 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.655906 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.656038 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.656208 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.656352 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.656527 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.656661 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.656832 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.656979 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.657123 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.657272 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.657433 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.657567 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.657734 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.657868 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.658036 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.658167 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.658359 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.658496 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.658664 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.658807 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.658948 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.659079 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.659254 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.659384 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.659554 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.659694 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.659866 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.659996 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.660170 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.660300 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.660470 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.660612 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.660788 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.660931 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.661093 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.661227 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.661396 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.661536 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.661704 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.662362 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.662640 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.662787 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.662948 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.663216 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.663354 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.663533 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.663666 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.663846 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.663993 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.664150 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.664287 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.664454 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.664593 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.664758 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.664904 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.665066 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.665203 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.665367 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.665463 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.665669 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.665756 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.665974 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.666063 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.666273 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.666410 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.666599 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.666678 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.666903 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.666991 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.667209 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.667284 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.667505 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.667589 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.667806 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.667880 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.668104 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.668194 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.668401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.668485 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.668702 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.668778 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.669002 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.669077 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.669301 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.669378 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.669599 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.669676 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.669917 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.670001 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.670222 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.670337 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.670547 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.670635 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.670876 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.670977 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.671147 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.671225 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.671483 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.671568 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.671797 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.673835 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.673835 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.674113 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.674255 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.674464 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.674606 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.674756 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.674893 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.675028 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.675173 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.675308 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.675454 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.675601 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.675742 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.675877 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676033 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676171 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676265 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676347 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676433 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676513 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676592 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676735 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676838 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.676980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.677072 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.677153 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.677153 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.677303 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.677303 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678035 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678133 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678220 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678301 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678444 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678542 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678635 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678725 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678805 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.678805 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.679021 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.679104 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.679183 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.679261 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.679339 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.679424 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.679623 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.679714 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.679948 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.680035 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.680260 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.680347 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.680563 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.680657 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.680869 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.680962 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.681174 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.681263 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.681489 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.681585 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.681799 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.681949 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.682113 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.682199 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.682445 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.682537 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.682764 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.682852 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.683071 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.683170 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.683381 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.683504 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.683681 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.683767 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.683982 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.684082 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.684311 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.684573 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.684669 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.684891 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.684978 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.685197 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.685285 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.685503 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.685653 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.685840 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.686004 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.686154 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.686385 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.686534 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.686680 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.686827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.686992 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.687149 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.687292 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.687440 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.687579 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.687732 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.687892 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.688050 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.688197 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.688341 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.688501 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.688647 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.688807 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.688954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.689118 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.689280 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.689429 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.689574 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.689730 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.689872 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.689993 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.690087 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.690298 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.690456 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.690616 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.690747 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.690939 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.691076 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.691248 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.691412 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.691559 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.691693 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.691828 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.691961 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.692149 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.692561 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.692701 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.692863 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.692997 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.693239 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.693460 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.693660 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.693794 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.693927 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.694084 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.694217 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.694425 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.694561 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.694735 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.694874 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.695044 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.695179 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.695330 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.695460 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.695646 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.695782 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.695959 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.696085 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.696266 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.696472 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.696622 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.696897 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.697040 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.697198 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.697331 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.697465 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.697598 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.697726 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.697939 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.698081 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.698249 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.698587 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.698687 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.698895 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.698989 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.699206 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.699283 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.699514 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.699590 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.699836 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.699926 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.700146 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.700222 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.700455 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.700531 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.700764 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.700850 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.701070 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.701145 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.701378 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.701468 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.701684 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.701759 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.701989 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.702248 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.702369 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.702603 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.702693 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.702916 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.703014 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.703215 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.703301 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.703514 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.703601 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.703822 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.703913 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.704121 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.704208 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.704420 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.704507 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.704718 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.704807 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.705018 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.705117 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.705327 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.705414 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.705626 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.705721 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.705937 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.706024 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.706236 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.706395 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.706562 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.706663 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.706866 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.706955 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.707160 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.707247 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.707458 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.707555 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.707756 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.707844 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.708056 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.708152 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.708365 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.708536 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.708719 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.708880 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.709037 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.709184 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.709343 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.709488 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.709636 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.709820 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.709970 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.710119 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.710281 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.710456 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.710602 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.710747 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.710894 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.711040 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.711198 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.711335 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.711460 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.711616 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.711765 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.711927 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.712074 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.712221 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.712433 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.712585 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.712722 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.712823 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.712907 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.713047 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.713213 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.713346 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.713516 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.713614 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.713838 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.713926 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.714142 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.714229 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.714472 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.714585 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.714774 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.714862 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.715082 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.715170 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.715385 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.715484 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.715681 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.715774 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.715980 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.716067 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.716283 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.716372 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.716587 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.716673 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.716883 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.716969 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.717180 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.717268 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.717479 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.717578 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.717783 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.717938 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.718097 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.718245 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.718415 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.718702 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.718857 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.719015 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.719171 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.719330 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.719477 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.719624 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.719773 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.719930 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.720060 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.720184 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.720304 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.720428 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.720608 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.720757 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.720923 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.721078 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.721233 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.721395 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.721541 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.721703 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.721852 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.722001 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.722130 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.722295 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.722578 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.722728 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.722830 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.722921 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.723014 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.723096 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.723308 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.723441 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.723611 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.723699 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.723914 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.724002 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.724220 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.724990 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.725204 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.725318 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.725513 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.725620 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.725813 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.725941 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.726116 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.726259 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.726443 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.726591 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.726769 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.726901 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.727124 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.727223 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.727375 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.727496 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.727676 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.727799 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.727975 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.728159 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.728354 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.728537 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.728625 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.728693 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.728949 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.729027 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.729251 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.729422 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.729556 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.729687 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.729861 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.729994 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.730170 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.730304 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.730531 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.730667 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.730799 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.730930 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.731092 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.731228 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.731406 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.731539 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.731713 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.731845 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.732083 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.732236 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.732382 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.732467 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.732595 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.732684 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.732899 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.732988 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.733205 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.733305 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.733511 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.733608 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.733827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.733915 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.734137 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.734291 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.734476 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.734570 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.734767 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.734863 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.735074 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.735163 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.735382 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.735478 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.735681 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.735768 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.735983 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.736069 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.736288 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.736385 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.736593 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.736679 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.736900 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.736990 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.737208 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.737308 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.737516 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.737611 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.737814 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.737901 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.738116 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.738211 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.738451 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.738544 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.738756 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.738842 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.739056 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.739152 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.739361 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.739460 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.739667 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.739755 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.740537 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.740686 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.740889 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.741070 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.741211 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.741342 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.741494 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.741627 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.741779 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.741914 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.742086 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.742359 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.742517 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.742714 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.742899 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.743036 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.743180 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.743328 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.743473 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.743609 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.743741 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.744005 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.744149 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.744318 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.744458 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.744629 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.744774 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.744931 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.745023 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.745327 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.745415 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.745634 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.745721 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.745940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.746037 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.746238 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.746347 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.746569 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.746657 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.746874 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.746972 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.747178 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.747274 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.747490 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.747576 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.747787 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.747884 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.748088 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.748197 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.748393 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.748545 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.748710 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.748831 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.749009 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.749119 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.749324 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.749423 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.749665 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.749771 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.749972 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.750071 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.750289 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.750416 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.750614 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.750722 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.750913 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.751025 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.751213 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.751315 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.751531 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.751621 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.751831 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.751939 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.752148 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.752258 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.752558 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.752649 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.752866 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.753028 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.753170 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.753322 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.753467 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.753609 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.753778 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.753913 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.754141 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.754290 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.754441 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.754588 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.754723 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.754858 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.755009 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.755145 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.755311 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.755416 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.756166 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.756318 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.756628 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.756706 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.756949 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.757170 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.757270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.757492 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.757569 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.757801 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.757886 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.758123 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.758219 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.758471 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.758554 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.758777 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.758865 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.759078 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.759155 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.759388 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.759464 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.759689 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.759774 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.759994 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.760093 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.760312 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.760397 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.760614 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.760704 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.761011 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.761086 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.761312 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.761498 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.761613 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.761919 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.761996 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.762364 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.762728 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.762864 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.762864 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.763129 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.763222 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.763304 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.763431 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.763737 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.763833 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.764042 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.764130 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.764341 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.764473 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.764643 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.764742 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.764959 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.765047 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.765257 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.765344 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.765572 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.765673 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.765881 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.765969 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.766181 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.766269 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.766523 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.766613 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.766824 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.766911 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.767142 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.767229 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.767447 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.767587 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.767745 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.767887 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.768033 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.768168 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.768314 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.768451 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.768652 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.768791 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.768961 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.769100 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.769279 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.769418 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.769601 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.769739 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.769918 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.770076 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.770212 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.770376 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.770561 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.770695 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.770859 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.771002 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.771193 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.771824 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.772126 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.772218 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.772452 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.772599 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.772747 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.772883 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.773022 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.773121 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.773339 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.773473 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.773612 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.773740 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.773912 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.774045 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.774212 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.774404 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.774569 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.774702 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.774849 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.774984 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.775094 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.775166 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.775399 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.775477 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.775722 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.775798 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.776021 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.776098 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.776336 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.776413 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.776703 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.776866 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.777001 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.777145 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.777280 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.777412 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.777555 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.777705 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.777834 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.778009 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.778141 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.778233 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.778475 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.778621 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.778798 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.778931 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.779110 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.779243 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.779426 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.779571 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.779729 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.779865 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.780037 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.780174 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.780350 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.780505 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.780643 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.780775 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.780952 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.781085 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.781262 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.781398 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.781572 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.781709 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.781882 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.782019 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.782196 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.782476 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.782626 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.782804 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.782949 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.783116 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.783259 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.783425 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.783565 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.783720 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.783965 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.784059 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.784293 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.784382 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.784605 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.784693 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.784908 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.785010 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.785214 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.785302 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.785518 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.785614 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.785825 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.785921 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.786131 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.786218 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.786464 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.786555 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.786824 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.786927 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.787135 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.787224 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.787459 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.787546 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.787771 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.787860 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.788084 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.788173 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.788414 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.788508 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.788732 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.788822 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.789032 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.789119 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.789342 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.789437 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.789698 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.789792 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.789959 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.790047 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.790265 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.790379 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.790602 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.790703 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.790910 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.790986 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.794711 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.794824 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.794903 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.794974 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795044 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795130 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795212 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795283 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795358 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795427 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795427 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795547 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795622 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795691 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795758 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795831 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795898 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.795972 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796040 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796106 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796172 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796237 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796303 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796377 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796445 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796514 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796622 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796698 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796773 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796864 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.796932 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797007 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797075 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797141 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797263 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797416 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797508 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797598 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797686 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797767 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797859 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797941 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.797941 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.798086 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.798164 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.798242 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.798355 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.798439 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.798618 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.798707 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.798922 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.799050 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.799221 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.799320 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.799523 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.799617 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.799825 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.799911 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.800139 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.800353 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.800442 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.800697 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.800785 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.801011 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.801113 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.801317 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.801394 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.801633 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.801844 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.802004 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.802191 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.802268 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.802585 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.802668 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.802911 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.803013 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.803262 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.803415 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.803575 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.803738 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.803883 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.804046 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.804186 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.804401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.804546 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.804686 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.804832 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.804966 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.805113 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.805247 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.805393 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.805559 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.805711 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.805848 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.805999 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.806154 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.806245 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.806488 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.806582 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.806805 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.806884 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.807191 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.807487 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.807590 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.807662 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.807729 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.807890 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.808037 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.808286 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.808379 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.808600 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.808749 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.808908 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.809044 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.809218 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.809353 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.809670 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.810134 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.810274 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.810700 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.810846 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.811141 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.811354 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.811626 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.811940 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.812139 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.812509 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.812656 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.813089 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.813224 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.813657 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.813800 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.814219 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.814385 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.814567 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.814695 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.814890 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.815120 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.815264 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.815578 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.815723 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.815910 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.816011 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.816222 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.816324 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.816548 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.816693 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.816861 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.817245 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.817636 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.817853 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.817988 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.818802 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.819323 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.819490 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.819739 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.819994 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.820607 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.820733 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.820868 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.820983 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.821082 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.821331 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.821420 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.821650 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.821746 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.821967 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.822120 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.822282 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.822441 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.822613 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.822758 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.822940 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.823076 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.823251 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.823386 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.823558 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.823697 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.823856 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.823995 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.824163 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.824298 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.824470 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.824618 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.824766 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.824903 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.825070 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.825204 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.825376 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.825518 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.825664 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.825803 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.825974 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.826108 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.826278 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.826482 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.826629 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.826765 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.826906 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.827043 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.827199 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.827364 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.827540 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.827676 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.827852 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.827995 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.828164 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.828307 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.828474 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.828565 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.828781 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.828924 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.829087 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.829220 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.829389 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.829529 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.829693 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.829825 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.829998 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.830133 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.830310 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.830463 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.830645 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.830732 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.830947 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.831043 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.831245 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.831367 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.831664 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.831761 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.831974 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.832061 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.832286 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.832381 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.832591 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.832688 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.832893 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.832988 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.833210 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.833297 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.833513 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.833614 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.834461 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.834620 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.834771 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.834864 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.835081 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.835179 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.835427 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.835529 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.838663 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.838791 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.838967 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839141 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839222 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839313 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839396 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839486 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839568 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839643 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839722 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839814 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839910 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.839992 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840072 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840164 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840247 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840327 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840419 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840501 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840637 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840731 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840812 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.840927 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841046 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841136 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841224 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841312 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841393 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841472 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841560 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841732 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841860 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.841946 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842035 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842110 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842189 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842268 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842370 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842464 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842554 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842636 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842721 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842815 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842896 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.842982 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.843071 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.843201 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.843286 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.843366 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.843444 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.843523 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.843616 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.843698 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.843915 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.844005 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.844243 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.844346 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.844563 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.844658 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.844882 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.845017 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.845191 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.845287 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.845509 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.845598 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.845815 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.845913 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.846129 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.846232 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.846476 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.846604 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.846795 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.846885 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.847100 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.847204 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.847430 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.847525 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.847743 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.847844 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.848058 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.848187 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.848362 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.848476 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.848665 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.848765 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.848971 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.849071 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.849524 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.849682 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.849682 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.849839 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.849932 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.850258 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.850384 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.850588 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.850689 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.850912 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.851011 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.851229 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.851328 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.851548 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.851645 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.851861 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.851958 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.852170 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.852268 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.852496 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.852594 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.852806 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.852904 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.853110 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.853207 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.853423 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.853529 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.853732 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.853829 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.854037 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.854134 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.854372 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.854518 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.854690 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.854785 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.855015 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.855107 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.855335 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.855436 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.855642 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.855734 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.855963 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857154 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857154 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857323 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857323 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857457 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857524 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857591 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857591 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857756 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857835 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857904 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.857969 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.858046 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.858484 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.858572 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.858654 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.858734 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:41:29.858814 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:41:29.858895 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:41:30.016054 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO dbcounter [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Registered counter for database nova_api Jun 23 10:41:30.016268 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO dbcounter [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Registered counter for database nova_api Jun 23 10:41:30.038311 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_db.sqlalchemy.engines [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:41:30.041551 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG oslo_db.sqlalchemy.engines [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:41:30.045082 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writer thread running {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:41:30.048363 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writer thread running {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:41:30.106931 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.context [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fbacf08-c442-40fa-9217-0ac16ded2d58(cell1) {{(pid=114940) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 10:41:30.109864 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.context [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fbacf08-c442-40fa-9217-0ac16ded2d58(cell1) {{(pid=114939) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 10:41:30.110948 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:41:30.112523 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:41:30.115926 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:41:30.116064 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG oslo_concurrency.lockutils [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:41:30.116657 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:41:30.116768 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG oslo_concurrency.lockutils [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:41:30.116934 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG oslo_concurrency.lockutils [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:41:30.117421 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO dbcounter [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Registered counter for database nova_cell0 Jun 23 10:41:30.118947 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG oslo_concurrency.lockutils [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:41:30.120992 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO dbcounter [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Registered counter for database nova_cell0 Jun 23 10:41:30.121655 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO dbcounter [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Registered counter for database nova_cell1 Jun 23 10:41:30.125456 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO dbcounter [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Registered counter for database nova_cell1 Jun 23 10:41:30.129163 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_db.sqlalchemy.engines [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:41:30.131517 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_db.sqlalchemy.engines [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:41:30.135069 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG oslo_db.sqlalchemy.engines [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:41:30.137523 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writer thread running {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:41:30.137955 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writer thread running {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:41:30.139022 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writer thread running {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:41:30.139546 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG oslo_db.sqlalchemy.engines [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:41:30.289422 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO dbcounter [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Registered counter for database nova_cell0 Jun 23 10:41:30.289733 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writer thread running {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:41:30.298629 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_db.sqlalchemy.engines [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:41:30.304629 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writer thread running {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:41:30.305566 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO dbcounter [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Registered counter for database nova_cell0 Jun 23 10:41:30.312613 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG oslo_db.sqlalchemy.engines [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:41:30.317619 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writer thread running {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:41:30.655788 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: WARNING keystonemiddleware.auth_token [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:41:30.660218 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: WARNING keystonemiddleware.auth_token [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:41:30.663146 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: WARNING keystonemiddleware.auth_token [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:41:30.667689 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: WARNING keystonemiddleware.auth_token [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:41:31.009342 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: WARNING keystonemiddleware.auth_token [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:41:31.009544 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: WARNING keystonemiddleware.auth_token [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:41:31.015255 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: WARNING keystonemiddleware.auth_token [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:41:31.015385 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: WARNING keystonemiddleware.auth_token [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:41:31.020525 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5617274e09c0 pid: 114940 (default app) Jun 23 10:41:31.020652 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5617274e09c0 pid: 114939 (default app) Jun 23 10:41:31.023258 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:41:31.024432 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-a7dc1ecc-a3eb-43d7-bbb9-66afa015e4f3 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001830 Jun 23 10:41:31.024849 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Thu Jun 23 10:41:31 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:42:48.610777 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:42:48.611925 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Jun 23 10:42:48.612334 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:42:48.625175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writing DB stats nova_api:SELECT=3 {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:48.626612 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writing DB stats nova_cell0:SELECT=3 {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:48.627770 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writing DB stats nova_cell1:SELECT=3 {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:48.628692 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:49.081709 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-83cfe6a2-1b37-49da-9fe6-1612331b11b5 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:42:49.110860 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-83cfe6a2-1b37-49da-9fe6-1612331b11b5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490847 Jun 23 10:42:49.111589 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1291 bytes} [Thu Jun 23 10:42:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:42:51.221225 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:42:51.222147 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-52747bfc-909e-4bd1-a777-6b9d48c5c589 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 23 10:42:51.226665 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 2/4] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:42:51.290235 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-e85f2424-8b0d-4de7-8cfc-fd8611ec3c5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "disk": 1, "vcpus": 1, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:42:51.309936 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:42:51.309936 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: warnings.warn(msg) Jun 23 10:42:51.340321 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-e85f2424-8b0d-4de7-8cfc-fd8611ec3c5d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110755 Jun 23 10:42:51.340902 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 3/5] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:42:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:42:51.356457 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_api:SELECT=3 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:51.357541 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_cell0:SELECT=3 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:51.358785 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_cell1:SELECT=3 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:51.359788 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:51.577270 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-43ce236e-ba78-45c6-9c5f-3bd25432b6ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:42:51.579728 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:42:51.579728 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: warnings.warn(msg) Jun 23 10:42:51.645657 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-43ce236e-ba78-45c6-9c5f-3bd25432b6ac admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294624 Jun 23 10:42:51.646363 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 3/6] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jun 23 10:42:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:42:53.874056 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-e85f2424-8b0d-4de7-8cfc-fd8611ec3c5d admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:42:53.875108 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-e85f2424-8b0d-4de7-8cfc-fd8611ec3c5d admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 23 10:42:53.875536 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 4/7] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:42:54.017919 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-4c15405e-0e70-4d49-bea4-e48265cc0070 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "ram": 512, "disk": 5, "name": "ds512M", "swap": 0}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:42:54.037325 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:42:54.037325 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: warnings.warn(msg) Jun 23 10:42:54.055370 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-4c15405e-0e70-4d49-bea4-e48265cc0070 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.172483 Jun 23 10:42:54.056032 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 4/8] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:42:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:42:54.071545 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-39caaa41-8d3e-4123-9186-eb9630f02719 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:42:54.073051 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:42:54.073051 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: warnings.warn(msg) Jun 23 10:42:54.106015 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-39caaa41-8d3e-4123-9186-eb9630f02719 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041608 Jun 23 10:42:54.106637 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 5/9] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jun 23 10:42:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:42:56.306426 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-4c15405e-0e70-4d49-bea4-e48265cc0070 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:42:56.307702 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-4c15405e-0e70-4d49-bea4-e48265cc0070 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Jun 23 10:42:56.308242 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:42:56.380687 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-8bfb3dac-99e0-42c2-8d89-d74db15c845b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:42:56.411358 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-8bfb3dac-99e0-42c2-8d89-d74db15c845b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.095800 Jun 23 10:42:56.422249 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 6/11] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:42:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:42:56.428024 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-756a7c75-7c6b-41e9-bfaf-264ebccdc08b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:42:56.476702 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-756a7c75-7c6b-41e9-bfaf-264ebccdc08b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053160 Jun 23 10:42:56.477758 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 6/12] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jun 23 10:42:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:42:58.810215 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-8bfb3dac-99e0-42c2-8d89-d74db15c845b admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:42:58.811169 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-8bfb3dac-99e0-42c2-8d89-d74db15c845b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 23 10:42:58.811570 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 7/13] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:42:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:42:58.875141 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-16a70a6b-b0b3-416f-a5e6-baf0d6658e8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "swap": 0}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:42:58.893044 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-16a70a6b-b0b3-416f-a5e6-baf0d6658e8f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075395 Jun 23 10:42:58.893602 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 7/14] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:42:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 10:42:58.905413 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-f5b42478-710c-486a-bd75-de4d14ead3d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:42:58.928966 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-f5b42478-710c-486a-bd75-de4d14ead3d8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027223 Jun 23 10:42:58.929554 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 8/15] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jun 23 10:42:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:43:01.082403 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-16a70a6b-b0b3-416f-a5e6-baf0d6658e8f admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:01.083755 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-16a70a6b-b0b3-416f-a5e6-baf0d6658e8f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005056 Jun 23 10:43:01.090784 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 8/16] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:43:01 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:01.174139 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-c537a4d5-fdfe-48fa-b8d6-b6f9df5f0572 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "ram": 4096}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:01.201611 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-c537a4d5-fdfe-48fa-b8d6-b6f9df5f0572 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.109623 Jun 23 10:43:01.202736 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 9/17] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:43:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:01.219808 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-57838bdb-13b3-4cea-9397-7c492a5c75b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:01.250224 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-57838bdb-13b3-4cea-9397-7c492a5c75b7 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034688 Jun 23 10:43:01.251169 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 9/18] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jun 23 10:43:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:43:03.389134 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-c537a4d5-fdfe-48fa-b8d6-b6f9df5f0572 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:03.390370 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-c537a4d5-fdfe-48fa-b8d6-b6f9df5f0572 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jun 23 10:43:03.391093 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 10/19] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:43:03.455713 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-77e270f2-e753-4c3f-85bf-453b20d2864a admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:03.483620 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-77e270f2-e753-4c3f-85bf-453b20d2864a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085551 Jun 23 10:43:03.484321 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1291 bytes} [Thu Jun 23 10:43:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:43:05.741200 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-c537a4d5-fdfe-48fa-b8d6-b6f9df5f0572 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:05.742585 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-c537a4d5-fdfe-48fa-b8d6-b6f9df5f0572 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001911 Jun 23 10:43:05.743135 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 11/21] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:05.810782 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-0ab4cd03-46c1-4d6b-a881-a43c96afb2c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:05.840592 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-0ab4cd03-46c1-4d6b-a881-a43c96afb2c8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.089415 Jun 23 10:43:05.842022 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 11/22] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:43:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:05.854470 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-2ccb726e-b6b3-479c-b7f7-234599f3ce94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:05.880418 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-2ccb726e-b6b3-479c-b7f7-234599f3ce94 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029691 Jun 23 10:43:05.881332 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 12/23] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jun 23 10:43:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:43:08.022139 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-0ab4cd03-46c1-4d6b-a881-a43c96afb2c8 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:08.023262 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-0ab4cd03-46c1-4d6b-a881-a43c96afb2c8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001865 Jun 23 10:43:08.023881 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:43:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:43:08.091510 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-6b6de4da-fe3b-4870-890a-9bccc213729f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "disk": 20, "id": "2"}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:08.110807 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-6b6de4da-fe3b-4870-890a-9bccc213729f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079361 Jun 23 10:43:08.111366 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 13/25] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:43:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 10:43:08.124663 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-6f646892-d911-4718-b88e-5d87cebd490d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:08.153934 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-6f646892-d911-4718-b88e-5d87cebd490d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031898 Jun 23 10:43:08.153934 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 13/26] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jun 23 10:43:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:43:10.272347 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-6b6de4da-fe3b-4870-890a-9bccc213729f admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:10.273356 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-6b6de4da-fe3b-4870-890a-9bccc213729f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 23 10:43:10.273754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:10.355196 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-84753129-642c-4b2d-ba6d-4c6ba712009d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:10.377178 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-84753129-642c-4b2d-ba6d-4c6ba712009d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.097029 Jun 23 10:43:10.377935 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 14/28] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:43:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:10.390517 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-34d8a4d6-e9a3-467e-98f5-68ff88f97222 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:10.415305 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-34d8a4d6-e9a3-467e-98f5-68ff88f97222 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028495 Jun 23 10:43:10.415908 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 15/29] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jun 23 10:43:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:43:12.539918 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-84753129-642c-4b2d-ba6d-4c6ba712009d admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:12.541437 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-84753129-642c-4b2d-ba6d-4c6ba712009d admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 23 10:43:12.541437 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 15/30] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:43:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:12.609898 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-521dd1a8-9e04-426a-bb43-d75ae813ce3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:12.630505 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-521dd1a8-9e04-426a-bb43-d75ae813ce3f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083129 Jun 23 10:43:12.631162 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 16/31] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:43:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 10:43:12.643147 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-48204f84-88b1-46aa-b4b0-a3c4a88e6c44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:12.670446 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-48204f84-88b1-46aa-b4b0-a3c4a88e6c44 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030902 Jun 23 10:43:12.671035 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 16/32] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jun 23 10:43:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:43:14.913159 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-521dd1a8-9e04-426a-bb43-d75ae813ce3f admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:14.914846 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-521dd1a8-9e04-426a-bb43-d75ae813ce3f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Jun 23 10:43:14.915956 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:43:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:15.009135 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-5e24b394-a4a7-4ab9-b96c-93779ae60544 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:15.032386 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-5e24b394-a4a7-4ab9-b96c-93779ae60544 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.108215 Jun 23 10:43:15.032949 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 17/34] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jun 23 10:43:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:15.046489 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-1c827a05-5e11-4c7d-9abf-aab8baa2748e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:15.077245 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-1c827a05-5e11-4c7d-9abf-aab8baa2748e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034295 Jun 23 10:43:15.078244 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 18/35] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jun 23 10:43:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:43:39.695218 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-5e24b394-a4a7-4ab9-b96c-93779ae60544 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:39.696232 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-5e24b394-a4a7-4ab9-b96c-93779ae60544 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 23 10:43:39.696632 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 18/36] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:43:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:39.708188 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:39.759751 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-a273ffae-27d7-4d69-9d2c-1e6a6d23a399 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:39.778367 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-a273ffae-27d7-4d69-9d2c-1e6a6d23a399 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075351 Jun 23 10:43:39.778965 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1291 bytes} [Thu Jun 23 10:43:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:43:40.741820 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-5e24b394-a4a7-4ab9-b96c-93779ae60544 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:40.742873 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-5e24b394-a4a7-4ab9-b96c-93779ae60544 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 23 10:43:40.743272 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:40.939905 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-6f9f4699-e9d9-487d-9bd5-4fc88fd99e2e admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:40.946896 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.wsgi [None req-6f9f4699-e9d9-487d-9bd5-4fc88fd99e2e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-6f9f4699-e9d9-487d-9bd5-4fc88fd99e2e admin admin] Request method failure captured: Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Accept: application/json Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Accept-Encoding: gzip, deflate Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Connection: keep-alive Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Content-Length: 0 Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Host: 10.222.0.39 Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Openstack-Api-Version: compute 2.90 Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Openstack-System-Scope: None Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: User-Agent: python-novaclient Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Auth-Token: gAAAAABitEPc0wJFtNFYlj4SqKDRs_EKQ0fF5YOLFVvfzEEcZLppVnwdpAJXrYYYZDK805PA9rm0NcpvTQufjFCBNqs9O_qT7YlTGyYl7KorjT8brGE49nVQF0gE3V-DBijQiSHQiLTIvBAOPVF7GFXnx29ui8gZrNPdSp1c_m989zzNFYvTPp0 Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Domain-Id: None Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Domain-Name: None Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Identity-Status: Confirmed Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Is-Admin-Project: True Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Domain-Id: default Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Domain-Name: Default Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Name: admin Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Role: admin,reader,member Jun 23 10:43:40.950143 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Roles: admin,reader,member Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_90bfbe3ca19640a8a67be01b638e500f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Tenant: admin Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Tenant-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Tenant-Name: admin Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User: admin Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Domain-Id: default Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Domain-Name: Default Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Id: a27ae7f7dcd846e6909f95c2447d5f53 Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Name: admin Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: method: > Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: exception: Flavor 42 could not be found. Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: action_args: {'id': '42'} Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:43:40.951754 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:40.952794 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:40.954175 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-6f9f4699-e9d9-487d-9bd5-4fc88fd99e2e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:43:40.955595 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-6f9f4699-e9d9-487d-9bd5-4fc88fd99e2e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065563 Jun 23 10:43:40.955595 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Jun 23 10:43:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 10:43:40.961492 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-d4121b42-8dc8-4709-a8ac-ff562493cfd8 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:40.964479 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:40.984516 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-d4121b42-8dc8-4709-a8ac-ff562493cfd8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026560 Jun 23 10:43:40.985085 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 20/40] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jun 23 10:43:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:43:40.996011 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-f8b4f5f6-c2b1-4391-96e6-b4c7bfefb94b admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:41.021745 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-f8b4f5f6-c2b1-4391-96e6-b4c7bfefb94b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029274 Jun 23 10:43:41.022306 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jun 23 10:43:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:43:41.032453 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-e54b007c-f1bc-4232-a5d6-6fb493d1ee26 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:41.039434 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.wsgi [None req-e54b007c-f1bc-4232-a5d6-6fb493d1ee26 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-e54b007c-f1bc-4232-a5d6-6fb493d1ee26 admin admin] Request method failure captured: Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Accept: application/json Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Accept-Encoding: gzip, deflate Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Connection: keep-alive Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Content-Length: 0 Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Host: 10.222.0.39 Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Openstack-Api-Version: compute 2.90 Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Openstack-System-Scope: None Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: User-Agent: python-novaclient Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Auth-Token: gAAAAABitEPc0wJFtNFYlj4SqKDRs_EKQ0fF5YOLFVvfzEEcZLppVnwdpAJXrYYYZDK805PA9rm0NcpvTQufjFCBNqs9O_qT7YlTGyYl7KorjT8brGE49nVQF0gE3V-DBijQiSHQiLTIvBAOPVF7GFXnx29ui8gZrNPdSp1c_m989zzNFYvTPp0 Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Domain-Id: None Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Domain-Name: None Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Identity-Status: Confirmed Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Is-Admin-Project: True Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Domain-Id: default Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Domain-Name: Default Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Name: admin Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Role: admin,reader,member Jun 23 10:43:41.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Roles: admin,reader,member Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_90bfbe3ca19640a8a67be01b638e500f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Tenant: admin Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Tenant-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Tenant-Name: admin Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User: admin Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Domain-Id: default Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Domain-Name: Default Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Id: a27ae7f7dcd846e6909f95c2447d5f53 Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Name: admin Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: method: > Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: exception: Flavor 42 could not be found. Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: action_args: {'id': '42'} Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:43:41.044125 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:41.044940 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:41.046259 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-e54b007c-f1bc-4232-a5d6-6fb493d1ee26 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:43:41.047339 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-e54b007c-f1bc-4232-a5d6-6fb493d1ee26 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015803 Jun 23 10:43:41.047339 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Jun 23 10:43:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:41.889160 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-f8b4f5f6-c2b1-4391-96e6-b4c7bfefb94b admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:41.890153 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-f8b4f5f6-c2b1-4391-96e6-b4c7bfefb94b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 23 10:43:41.890585 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 22/43] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:42.087968 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-d508f865-f5e1-4b6b-be78-532b710abb49 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:42.093456 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.wsgi [None req-d508f865-f5e1-4b6b-be78-532b710abb49 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-d508f865-f5e1-4b6b-be78-532b710abb49 admin admin] Request method failure captured: Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Accept: application/json Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Accept-Encoding: gzip, deflate Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Connection: keep-alive Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Content-Length: 0 Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Host: 10.222.0.39 Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Openstack-Api-Version: compute 2.90 Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Openstack-System-Scope: None Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: User-Agent: python-novaclient Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Auth-Token: gAAAAABitEPdX89PAH6DUu8fwCDMLx7U5zzX0-U_Vbfl-eLoAOAVnhKfPQdiOU3ULpMjjepH83-e9NupXBRT-MjxBuC6CXM2aNG5CQFM--6Xnn9M5_0BjIIEs0LMHvb_GBIovdfVOpb6xQ76TciVeEfMyzs2XtGI1NSARrqgbWczO7X-e5nLDu4 Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Domain-Id: None Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Domain-Name: None Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Identity-Status: Confirmed Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Is-Admin-Project: True Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Domain-Id: default Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Domain-Name: Default Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Name: admin Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Role: admin,reader,member Jun 23 10:43:42.094954 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Roles: admin,reader,member Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_90bfbe3ca19640a8a67be01b638e500f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Tenant: admin Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Tenant-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Tenant-Name: admin Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User: admin Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Domain-Id: default Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Domain-Name: Default Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Id: a27ae7f7dcd846e6909f95c2447d5f53 Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Name: admin Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: method: > Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: exception: Flavor 84 could not be found. Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: action_args: {'id': '84'} Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:43:42.097042 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:42.098057 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.099326 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-d508f865-f5e1-4b6b-be78-532b710abb49 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:43:42.100767 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-d508f865-f5e1-4b6b-be78-532b710abb49 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065950 Jun 23 10:43:42.100767 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Jun 23 10:43:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:42.111750 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-6b6f1043-0f05-42cf-b90a-1dd7446cbb2b admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:42.127221 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-6b6f1043-0f05-42cf-b90a-1dd7446cbb2b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021013 Jun 23 10:43:42.128289 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jun 23 10:43:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:43:42.138881 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-1534b164-9310-4c86-b8f0-7a8b2d7f9193 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:42.155504 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-1534b164-9310-4c86-b8f0-7a8b2d7f9193 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020113 Jun 23 10:43:42.156064 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jun 23 10:43:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:43:42.165711 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-f1c26013-1a33-4f9f-a124-63539a5c3302 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:42.172024 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.wsgi [None req-f1c26013-1a33-4f9f-a124-63539a5c3302 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-f1c26013-1a33-4f9f-a124-63539a5c3302 admin admin] Request method failure captured: Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Accept: application/json Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Accept-Encoding: gzip, deflate Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Connection: keep-alive Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Content-Length: 0 Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Host: 10.222.0.39 Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Openstack-Api-Version: compute 2.90 Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Openstack-System-Scope: None Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: User-Agent: python-novaclient Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Auth-Token: gAAAAABitEPdX89PAH6DUu8fwCDMLx7U5zzX0-U_Vbfl-eLoAOAVnhKfPQdiOU3ULpMjjepH83-e9NupXBRT-MjxBuC6CXM2aNG5CQFM--6Xnn9M5_0BjIIEs0LMHvb_GBIovdfVOpb6xQ76TciVeEfMyzs2XtGI1NSARrqgbWczO7X-e5nLDu4 Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Domain-Id: None Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Domain-Name: None Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Identity-Status: Confirmed Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Is-Admin-Project: True Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Domain-Id: default Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Domain-Name: Default Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Name: admin Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Role: admin,reader,member Jun 23 10:43:42.173650 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Roles: admin,reader,member Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_90bfbe3ca19640a8a67be01b638e500f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Tenant: admin Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Tenant-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Tenant-Name: admin Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User: admin Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Domain-Id: default Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Domain-Name: Default Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Id: a27ae7f7dcd846e6909f95c2447d5f53 Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Name: admin Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: method: > Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: exception: Flavor 84 could not be found. Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: action_args: {'id': '84'} Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:43:42.176392 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:42.177270 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:42.178380 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-f1c26013-1a33-4f9f-a124-63539a5c3302 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:43:42.179402 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-f1c26013-1a33-4f9f-a124-63539a5c3302 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013668 Jun 23 10:43:42.179402 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 24/47] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Jun 23 10:43:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:43.048886 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-1534b164-9310-4c86-b8f0-7a8b2d7f9193 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:43.050111 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-1534b164-9310-4c86-b8f0-7a8b2d7f9193 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 23 10:43:43.050642 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 24/48] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:43:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:43:43.249028 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-7afa94d6-d2ab-412e-bc82-c375c307282e admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:43.255854 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.wsgi [None req-7afa94d6-d2ab-412e-bc82-c375c307282e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-7afa94d6-d2ab-412e-bc82-c375c307282e admin admin] Request method failure captured: Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Accept: application/json Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Accept-Encoding: gzip, deflate Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Connection: keep-alive Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Content-Length: 0 Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Host: 10.222.0.39 Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Openstack-Api-Version: compute 2.90 Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Openstack-System-Scope: None Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: User-Agent: python-novaclient Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Auth-Token: gAAAAABitEPfhadet5SZXIhh_w1lWmKWwv-nkybR50vGLpsnsQfXvx--A7x0cMI7SsyJxTSAfjSNfwP3V5L9GY90mS5ntfLvb7eHrUn7qtG-Z_xXm9HbCS1NZGV9PlIHkeYQMw5qr5VSUiAZ54dIqlcgBXVwIrd2s8XzyTwPqKsv4p0u4JigAcY Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Domain-Id: None Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Domain-Name: None Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Identity-Status: Confirmed Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Is-Admin-Project: True Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Domain-Id: default Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Domain-Name: Default Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Project-Name: admin Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Role: admin,reader,member Jun 23 10:43:43.257401 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Roles: admin,reader,member Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_90bfbe3ca19640a8a67be01b638e500f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Tenant: admin Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Tenant-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-Tenant-Name: admin Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User: admin Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Domain-Id: default Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Domain-Name: Default Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Id: a27ae7f7dcd846e6909f95c2447d5f53 Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: X-User-Name: admin Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: method: > Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: exception: Flavor 451 could not be found. Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: action_args: {'id': '451'} Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:43:43.258856 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:43.259651 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.260980 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-7afa94d6-d2ab-412e-bc82-c375c307282e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:43:43.262033 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-7afa94d6-d2ab-412e-bc82-c375c307282e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070373 Jun 23 10:43:43.262033 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 25/49] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jun 23 10:43:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:43.268662 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-14490df1-9025-4c87-afb4-2821c0a3cbd9 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:43.283333 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-14490df1-9025-4c87-afb4-2821c0a3cbd9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018239 Jun 23 10:43:43.283911 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 25/50] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jun 23 10:43:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:43:43.294488 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:43.309319 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018486 Jun 23 10:43:43.309879 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 26/51] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jun 23 10:43:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:43:43.320672 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-11981fdd-8963-464d-8377-e6bc204cc02a admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:43.326181 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.wsgi [None req-11981fdd-8963-464d-8377-e6bc204cc02a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-11981fdd-8963-464d-8377-e6bc204cc02a admin admin] Request method failure captured: Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Accept: application/json Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Accept-Encoding: gzip, deflate Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Connection: keep-alive Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Content-Length: 0 Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Host: 10.222.0.39 Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Openstack-Api-Version: compute 2.90 Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Openstack-System-Scope: None Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: User-Agent: python-novaclient Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Auth-Token: gAAAAABitEPfhadet5SZXIhh_w1lWmKWwv-nkybR50vGLpsnsQfXvx--A7x0cMI7SsyJxTSAfjSNfwP3V5L9GY90mS5ntfLvb7eHrUn7qtG-Z_xXm9HbCS1NZGV9PlIHkeYQMw5qr5VSUiAZ54dIqlcgBXVwIrd2s8XzyTwPqKsv4p0u4JigAcY Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Domain-Id: None Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Domain-Name: None Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Identity-Status: Confirmed Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Is-Admin-Project: True Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Domain-Id: default Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Domain-Name: Default Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Project-Name: admin Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Role: admin,reader,member Jun 23 10:43:43.327738 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Roles: admin,reader,member Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_90bfbe3ca19640a8a67be01b638e500f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90bfbe3ca19640a8a67be01b638e500f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Tenant: admin Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Tenant-Id: 90bfbe3ca19640a8a67be01b638e500f Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-Tenant-Name: admin Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User: admin Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Domain-Id: default Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Domain-Name: Default Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Id: a27ae7f7dcd846e6909f95c2447d5f53 Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: X-User-Name: admin Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: method: > Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: exception: Flavor 451 could not be found. Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: action_args: {'id': '451'} Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:43:43.329357 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:43.330239 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: ERROR nova.api.openstack.wsgi Jun 23 10:43:43.331409 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-11981fdd-8963-464d-8377-e6bc204cc02a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:43:43.332627 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-11981fdd-8963-464d-8377-e6bc204cc02a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012561 Jun 23 10:43:43.332627 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 26/52] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jun 23 10:43:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:44.182378 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:44.183404 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 23 10:43:44.183823 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:43:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:44.374974 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-bbfc4d5d-ef04-4193-a480-d73901d2d33c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:44.392924 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-bbfc4d5d-ef04-4193-a480-d73901d2d33c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071495 Jun 23 10:43:44.393909 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 27/54] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Jun 23 10:43:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:45.259051 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:45.260185 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Jun 23 10:43:45.260585 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:43:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:45.460971 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-d5c739f2-5ed9-42cf-b43a-ae09e988266c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:45.480429 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-d5c739f2-5ed9-42cf-b43a-ae09e988266c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073880 Jun 23 10:43:45.481163 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 28/56] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Jun 23 10:43:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:46.330077 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:46.331205 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 23 10:43:46.331621 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:43:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:46.527124 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-b31ee88f-3cda-49d6-8108-e4819cc74103 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:46.547148 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-b31ee88f-3cda-49d6-8108-e4819cc74103 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.077576 Jun 23 10:43:46.547707 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 29/58] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Jun 23 10:43:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:47.392538 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:47.394174 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 23 10:43:47.394868 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 30/59] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:43:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:47.590397 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-0bf3b48f-38b2-4d6c-ba4e-7425e7f12146 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:43:47.608833 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-0bf3b48f-38b2-4d6c-ba4e-7425e7f12146 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074850 Jun 23 10:43:47.609298 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 30/60] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Jun 23 10:43:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:48.451592 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:48.452625 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 23 10:43:48.453049 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 31/61] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:43:48.649572 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-24abbbd0-4c08-4029-8b68-565d3ada047c admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:43:48.669926 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-24abbbd0-4c08-4029-8b68-565d3ada047c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076587 Jun 23 10:43:48.670433 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 31/62] 10.222.0.39 () {60 vars in 1202 bytes} [Thu Jun 23 10:43:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:44:37.416422 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:44:37.417430 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-875b4bf6-64d9-4f10-871b-27f2f992c9f2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 23 10:44:37.417828 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 32/63] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jun 23 10:44:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:44:37.429481 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:44:37.482277 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-aafad123-1220-412b-a3ba-c96775e73ada admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:44:37.502649 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-aafad123-1220-412b-a3ba-c96775e73ada admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077233 Jun 23 10:44:37.503197 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 32/64] 10.222.0.39 () {60 vars in 1291 bytes} [Thu Jun 23 10:44:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:44:37.526557 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-662e3099-6c3b-497d-b2a7-167c7483e64d admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:44:37.529978 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG dbcounter [-] [114939] Writing DB stats nova_api:SELECT=14 {{(pid=114939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:44:37.536624 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-662e3099-6c3b-497d-b2a7-167c7483e64d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013622 Jun 23 10:44:37.537413 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 33/65] 10.222.0.39 () {60 vars in 1282 bytes} [Thu Jun 23 10:44:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:44:37.552873 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-c030a577-26a2-4f64-95ef-e46ef4130bdf admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:44:37.560902 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-c030a577-26a2-4f64-95ef-e46ef4130bdf admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012259 Jun 23 10:44:37.561742 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 33/66] 10.222.0.39 () {60 vars in 1285 bytes} [Thu Jun 23 10:44:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:44:37.577312 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:44:37.587847 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017419 Jun 23 10:44:37.588417 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 34/67] 10.222.0.39 () {60 vars in 1285 bytes} [Thu Jun 23 10:44:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:44:37.601209 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-d85ba990-9c9e-4e59-84fd-96ccd98217fe admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:44:37.608932 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-d85ba990-9c9e-4e59-84fd-96ccd98217fe admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011426 Jun 23 10:44:37.609479 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 34/68] 10.222.0.39 () {60 vars in 1282 bytes} [Thu Jun 23 10:44:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:47:54.090722 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:47:54.091728 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 23 10:47:54.092123 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 35/69] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:47:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:47:54.233676 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_api:SELECT=6 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:47:54.348633 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-7a1e9953-f42b-41f3-9bc0-f102e2383a66 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:47:54.350751 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:47:54.350751 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: warnings.warn(msg) Jun 23 10:47:54.352382 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-7a1e9953-f42b-41f3-9bc0-f102e2383a66 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:47:54.353152 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-7a1e9953-f42b-41f3-9bc0-f102e2383a66 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:47:54.354031 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-7a1e9953-f42b-41f3-9bc0-f102e2383a66 admin admin] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:47:54.354505 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-7a1e9953-f42b-41f3-9bc0-f102e2383a66 admin admin] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:47:54.391859 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-7a1e9953-f42b-41f3-9bc0-f102e2383a66 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159601 Jun 23 10:47:54.392422 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 35/70] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jun 23 10:47:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:47:55.220360 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:47:55.221362 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 23 10:47:55.221757 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:47:55.422135 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-64f3f533-39f5-40cc-94bd-6bedb273ad2c admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:47:55.424170 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:47:55.424170 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: warnings.warn(msg) Jun 23 10:47:55.425397 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-64f3f533-39f5-40cc-94bd-6bedb273ad2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:47:55.425834 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-64f3f533-39f5-40cc-94bd-6bedb273ad2c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:47:55.426709 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-64f3f533-39f5-40cc-94bd-6bedb273ad2c admin admin] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:47:55.427133 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-64f3f533-39f5-40cc-94bd-6bedb273ad2c admin admin] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:47:55.446864 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-64f3f533-39f5-40cc-94bd-6bedb273ad2c admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078940 Jun 23 10:47:55.447408 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jun 23 10:47:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:48:06.690926 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:48:06.691923 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 23 10:48:06.692312 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:48:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:48:06.838528 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_cell0:SELECT=4 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:06.839260 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_cell1:SELECT=4 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:06.839861 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG dbcounter [-] [114940] Writing DB stats nova_api:SELECT=8 {{(pid=114940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:06.889604 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-f2b155b9-b2fd-44c4-b4dd-e5cc41496e02 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:48:06.890804 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:48:06.890804 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: warnings.warn(msg) Jun 23 10:48:06.891969 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-f2b155b9-b2fd-44c4-b4dd-e5cc41496e02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:48:06.892423 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-f2b155b9-b2fd-44c4-b4dd-e5cc41496e02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:48:06.893199 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-f2b155b9-b2fd-44c4-b4dd-e5cc41496e02 admin admin] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:48:06.893616 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-f2b155b9-b2fd-44c4-b4dd-e5cc41496e02 admin admin] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:48:06.918106 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-f2b155b9-b2fd-44c4-b4dd-e5cc41496e02 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084049 Jun 23 10:48:06.918681 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 37/74] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jun 23 10:48:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:48:07.761557 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: DEBUG nova.api.openstack.wsgi [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] Calling method '>' {{(pid=114939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:48:07.762579 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: INFO nova.api.openstack.requestlog [None req-e2d74262-0d65-46f8-8cac-2e508aa15ff1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 23 10:48:07.762966 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: [pid: 114939|app: 0|req: 38/75] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jun 23 10:48:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:48:07.955051 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG nova.api.openstack.wsgi [None req-1da1e194-c608-4013-bb66-3a329f71b1f9 admin admin] Calling method '>' {{(pid=114940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:48:07.956476 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:48:07.956476 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: warnings.warn(msg) Jun 23 10:48:07.957997 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-1da1e194-c608-4013-bb66-3a329f71b1f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:48:07.958474 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-1da1e194-c608-4013-bb66-3a329f71b1f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:48:07.959333 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-1da1e194-c608-4013-bb66-3a329f71b1f9 admin admin] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:48:07.959762 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: DEBUG oslo_concurrency.lockutils [None req-1da1e194-c608-4013-bb66-3a329f71b1f9 admin admin] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:48:07.981121 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: INFO nova.api.openstack.requestlog [None req-1da1e194-c608-4013-bb66-3a329f71b1f9 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079635 Jun 23 10:48:07.981658 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: [pid: 114940|app: 0|req: 38/76] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jun 23 10:48:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:49:03.613338 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: Thu Jun 23 10:49:03 2022 - graceful shutdown triggered... Jun 23 10:49:03.613842 dv-cinder-846146-4-iscsi devstack@n-api.service[114939]: Gracefully killing worker 1 (pid: 114939)... Jun 23 10:49:03.613445 dv-cinder-846146-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 10:49:03.614662 dv-cinder-846146-4-iscsi devstack@n-api.service[114940]: Gracefully killing worker 2 (pid: 114940)... Jun 23 10:49:04.614480 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: worker 1 buried after 1 seconds Jun 23 10:49:04.614943 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: worker 2 buried after 1 seconds Jun 23 10:49:04.614943 dv-cinder-846146-4-iscsi devstack@n-api.service[114938]: goodbye to uWSGI. Jun 23 10:49:04.616090 dv-cinder-846146-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 10:49:04.616638 dv-cinder-846146-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 10:49:04.619416 dv-cinder-846146-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 10:49:04.629721 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 10:49:04.631717 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 10:49:04 2022] *** Jun 23 10:49:04.631880 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 10:49:04.632020 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 10:49:04.632150 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: nodename: dv-cinder-846146-4-iscsi Jun 23 10:49:04.632262 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: machine: x86_64 Jun 23 10:49:04.632576 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: clock source: unix Jun 23 10:49:04.632576 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: pcre jit disabled Jun 23 10:49:04.632576 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: detected number of CPU cores: 4 Jun 23 10:49:04.632576 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: current working directory: / Jun 23 10:49:04.632576 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: detected binary path: /usr/bin/uwsgi-core Jun 23 10:49:04.632576 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: your processes number limit is 47680 Jun 23 10:49:04.632576 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: your memory page size is 4096 bytes Jun 23 10:49:04.632576 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: detected max file descriptor number: 2048 Jun 23 10:49:04.632576 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: lock engine: pthread robust mutexes Jun 23 10:49:04.633268 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: thunder lock: enabled Jun 23 10:49:04.633364 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 10:49:04.633629 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 10:49:04.682661 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: Python main interpreter initialized at 0x55a869ada9c0 Jun 23 10:49:04.682661 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: python threads support enabled Jun 23 10:49:04.682661 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: your server socket listen backlog is limited to 100 connections Jun 23 10:49:04.682661 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: your mercy for graceful operations on workers is 90 seconds Jun 23 10:49:04.683151 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 10:49:04.683151 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: *** Operational MODE: preforking *** Jun 23 10:49:04.683383 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: *** uWSGI is running in multiple interpreter mode *** Jun 23 10:49:04.683383 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: spawned uWSGI master process (pid: 129448) Jun 23 10:49:04.683589 dv-cinder-846146-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 10:49:04.684166 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: spawned uWSGI worker 1 (pid: 129460, cores: 1) Jun 23 10:49:04.685153 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: spawned uWSGI worker 2 (pid: 129461, cores: 1) Jun 23 10:49:04.685493 dv-cinder-846146-4-iscsi devstack@n-api.service[129448]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 10:49:05.349543 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 10:49:05.350149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 10:49:06.544742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:49:06.544742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: from cryptography.utils import int_from_bytes Jun 23 10:49:06.545374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:49:06.545374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: from cryptography.utils import int_from_bytes Jun 23 10:49:06.568981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:49:06.568981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: from cryptography.utils import int_from_bytes Jun 23 10:49:06.569559 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:49:06.569559 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: from cryptography.utils import int_from_bytes Jun 23 10:49:08.964809 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:49:08.965391 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:49:08.965616 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:49:08.965981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:49:08.966277 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:49:08.966647 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.967481 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.967481 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.967707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.967960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.968239 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.968564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.968885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.969804 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.971654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.971654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.971654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-4-iscsi {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.971654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.971654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.972034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.972034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.972344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.972670 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.972979 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.973576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.973938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.974251 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.974597 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.975013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.975268 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.975578 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.975884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.976205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.976515 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.976825 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.977232 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-4-iscsi {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.977555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.977880 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.978194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.978642 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.978957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.979291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.979609 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.979922 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.980223 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.980566 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.980889 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.981209 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.981528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.981835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.982145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.982485 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.982808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.983117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.983423 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.983677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.983987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.984312 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.984631 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.985248 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.985497 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.985829 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.986154 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.986511 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.986827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.987138 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.987447 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.987755 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.988063 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.988370 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.988679 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.988987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.989309 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.989627 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.989953 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.990263 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.990613 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.991029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.991285 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.991594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.991941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.992261 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.992572 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.992894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.993283 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.993527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.993838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.994146 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.994498 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.994842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.995151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.995406 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.995711 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.996123 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.996335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.996645 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.997908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.997908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.997908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.997908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.998523 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.998523 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.998956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.999106 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.999535 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.999699 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:08.999932 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.000256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.001119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.001119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.001450 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.001595 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.001824 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.002132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.002659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.002973 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.003286 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.003615 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.003929 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.004240 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.004561 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.004871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.005180 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.005502 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.006151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.006151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.006555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.006749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.007055 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.007362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.007666 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.007971 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.008278 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.008582 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.008886 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.009190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.009512 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.009835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.010148 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.010482 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.010789 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.011109 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.011452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.011785 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.012130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.012445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.012778 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.013109 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.013425 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.013738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.014056 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.014403 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.014719 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.015032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.015344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.015663 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.016663 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.017000 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.017000 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.017705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.017859 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.018175 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.018518 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.018851 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.019189 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.019487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.019829 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.020174 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.020489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.020847 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.021175 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.021911 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.021911 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.022127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.022374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.022707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.023019 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.023337 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.023651 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.023963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.024272 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.024579 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.024888 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.025226 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.025539 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.025854 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.026165 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.026521 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.026838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.027146 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.027456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.027761 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.028066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.028351 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:49:09.028769 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.028864 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:49:09.028937 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.028937 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.029184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:49:09.029278 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.029505 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:49:09.029617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.029769 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:49:09.029862 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.030150 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.030246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.030520 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.030629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.030833 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.030937 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.031144 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.031248 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.031456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.032275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.032893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.032986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.033062 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.033133 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.033218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.033291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.033514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.033676 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.033832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.034013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.034167 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.034343 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.034505 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-4-iscsi {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.034659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.034804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.034960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.035112 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.035273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.035418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.035567 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.035711 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.035935 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.036082 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.036224 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.036368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.036516 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.036659 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.036817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.036989 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.037133 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.037306 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.037450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.037606 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.037757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.037901 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.038043 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.038186 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.038354 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.038532 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.039164 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.039325 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.039489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.039635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.039788 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.039939 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.040083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.040226 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.040375 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.040518 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.040673 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.040673 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.040952 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-4-iscsi {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.041106 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.041260 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.041412 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.041563 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.041706 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.041848 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.041997 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.042154 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.042307 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.042478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.042633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.042785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.042928 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.043080 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.043246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.043390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.043540 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.043691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.043834 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.043986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.044130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.044130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.044419 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.044568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.044718 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.044871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.045022 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.045183 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.045333 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.045487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.045638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.045638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.045932 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.046075 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.046226 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.046449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.046609 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.046753 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.046901 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.046901 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.047205 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.047470 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.047638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.047785 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.047936 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.048080 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.048223 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.048381 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.048543 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.048706 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.049220 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.049454 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.049616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.049856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.050014 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.050172 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.050334 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.050497 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.050643 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.050811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.051025 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.051173 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.051323 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.051475 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.051630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.051774 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.051930 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.052081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.052232 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.052381 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.052534 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.052534 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.052822 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.052966 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.053108 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.053257 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.053400 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.053561 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.053717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.053860 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.054009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.054153 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.054295 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.054295 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.054655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.054800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.054800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.055088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.055231 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.055231 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.055520 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.055664 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.055806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.055955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.056098 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.056249 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.056392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.056542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.056687 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.056830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.056979 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.057135 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.057295 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.057439 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.057588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.057732 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.057732 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.058023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.058166 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.058308 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.058485 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.058630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.058781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.058943 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.059414 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.059678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.059836 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.059981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.060134 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.060285 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.060428 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.060579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.060722 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.060873 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.061025 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.061168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.061317 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.061468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.061753 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.061918 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.062073 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.062218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.062464 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.062616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.063274 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.063507 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.063653 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.063805 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.063956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.064109 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.064318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.064475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.064621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.064764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.064764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.065034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.065186 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.065338 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.065616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.065802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.065960 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.066113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.066298 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.066489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.066641 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.066784 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.066927 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.067077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.067230 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.067373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.067532 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.067718 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.067879 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.068030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.068030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.068310 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.068471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.068629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.068781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.068932 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.069075 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.069561 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.069809 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.069977 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.070130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.070130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.070457 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.070604 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.070756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.070929 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.071083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.071233 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.071645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.071798 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.071952 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.072109 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.072254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.072397 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.072547 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.072690 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.072846 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.072989 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.073151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.073301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.073446 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.073589 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.073741 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.073884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.074027 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.074169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.074365 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.074527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.074685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.074836 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.075001 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.075144 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.075286 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.075438 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.075591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.075741 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.075893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.075893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.076164 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.076314 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.076465 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.076616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:49:09.076770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.077100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.077254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.077412 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.077556 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.077708 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.077858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.078001 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.079190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.079190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.079979 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.080132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.080285 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.080456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.080602 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.080745 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.080905 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.081057 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.081057 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.081340 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.081340 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.081617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.081761 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.081904 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.082056 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.082214 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.082404 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.082561 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.082718 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.082874 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.083034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.083183 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.083332 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.083487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.083645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.083808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.083967 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.084117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.084273 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.084434 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.084583 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.084746 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.084905 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.085062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.085062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.085354 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.085502 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.085660 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.085817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.085979 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.086132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.086288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.086472 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.086641 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.086798 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.086949 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.087105 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.087259 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.087419 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.087569 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.087718 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.087874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.088032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.088183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.088350 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.088508 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.088658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.088806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.088962 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.089119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.089278 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.089278 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.089918 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.090177 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.090396 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.090570 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.090729 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.090891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.091050 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.091208 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.091359 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.091523 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.091692 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.091842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.091991 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.092140 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.092290 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.092453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.092611 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.092768 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.092768 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.093076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.093232 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.093460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.093619 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.093770 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.093927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.094198 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.094383 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.094555 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.094707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.094857 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.095007 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.095217 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.095390 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.095550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.095701 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.095851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.096000 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.096150 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.096317 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.096482 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.096639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.096793 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.096953 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.097128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.097288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.097438 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.097595 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.097753 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.097903 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.098052 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.098215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.098401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.098558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.098710 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.098867 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.099154 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.099343 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.099496 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.099665 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.100191 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.100443 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.100615 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.100773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.100924 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.101073 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.101073 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.101374 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.101537 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.101695 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.101857 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.102007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.102163 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.102352 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.102528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.102681 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.102831 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.102997 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.103156 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.103315 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.103473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.103623 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.103779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.103942 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.104098 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.104262 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.104419 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.104577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.104726 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.104875 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.105079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.105246 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.105397 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.105546 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.105694 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.105861 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.106012 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.106180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.106350 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.106518 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.106676 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.106676 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.106973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.107132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.107282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.107430 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.107586 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.107736 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.107905 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.108057 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.108216 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.108216 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.108516 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.108673 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.108841 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.108993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.109143 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.109315 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.109474 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.109655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.109823 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.110401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.110668 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.110834 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.110994 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.111159 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.111319 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.111478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.111629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.111629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.111913 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.112077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.112236 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.112388 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.112557 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.112714 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.112872 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.113032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.113032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.113320 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.113469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.113664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.113838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.114006 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.114157 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.114307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.114487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.114660 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.114825 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.114976 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.115126 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.115282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.115433 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.115599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.115759 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.115911 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.116070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.116221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.116379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.116548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.116708 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.116859 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.117009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.117009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.117302 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.117452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.117611 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.117763 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.117914 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.118063 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.118221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.118453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.118632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.118783 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.118939 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.119089 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.119247 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.119444 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.119598 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.119748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.119898 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.120071 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.120594 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.120869 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.121035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.121199 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.121350 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.121500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.121658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.121822 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.121973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.122122 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.122279 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.122483 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.122483 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.122789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.122938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.123088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.123256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.123415 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.123575 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.123725 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.123883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.124034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.124184 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.124333 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.124491 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.124648 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.124799 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.124957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.125107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.125806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.125981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.126133 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.126291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.126486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.126638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.126885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.127047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.127200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.127350 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.127507 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.127658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.127897 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.128051 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.128051 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.128345 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.128494 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.128645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.128804 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.128955 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.129105 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.129268 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.129427 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.129585 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.129585 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.129917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.130070 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.130226 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.130766 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.131039 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.131211 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.131364 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.131523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.131674 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.131865 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.132030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.132184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.132184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.132487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.132639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.132796 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.132956 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.133106 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.133264 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.133415 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.133567 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.133717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.133876 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.134027 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.134184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.134365 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.134544 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.134705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.134856 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.135006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.135163 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.135323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.135323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.135682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.135845 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.135997 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.135997 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.136290 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.136290 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.136609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.136609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.136903 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.137053 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.137204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.137361 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.137521 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.137679 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.137837 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.137837 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.138129 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.138129 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.138493 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.138656 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.138807 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.138807 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.139092 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.139254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.139405 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.139554 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.139704 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.139860 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.140010 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.140178 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.140336 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.140526 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.141896 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.142065 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.142226 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.142452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.142618 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.142779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.142938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.143089 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.143254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.143412 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.143570 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.143729 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.143892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.144043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.144204 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.144362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.144520 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.144671 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.144821 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.144978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.145143 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.145302 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.145302 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.145589 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.145749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.145908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.146072 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.146232 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.146410 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.146564 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.146715 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.146715 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.147021 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.147179 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.147330 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.147479 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.147629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.147629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.147949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.148106 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.148257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.148257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.148540 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.148699 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.148858 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.149008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.149159 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.149316 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.149467 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.149629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.149802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.149953 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.150113 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.150266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.150476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.150629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.151238 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.151400 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.151562 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.151721 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.151890 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.152129 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.152306 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.152465 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.152631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.152789 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.152949 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.153101 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.153253 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.153412 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.153565 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.153716 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.153867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.154018 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.154168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.154363 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.154531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.154684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.154843 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.155002 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.155153 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.155318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.155318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.155613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.155772 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.155931 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.156090 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.156253 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.156416 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.157117 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.157376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.157534 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.157696 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.157855 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.158007 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.158166 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.158403 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.158574 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.158735 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.158887 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.159046 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.159214 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.159372 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.159525 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.159688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.159839 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.159988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.160139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.160303 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.160454 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.160619 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.160769 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.161280 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.161454 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.161607 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.161766 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.161918 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.162068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.162333 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.162494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.162658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.162824 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.162977 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.163189 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.163340 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.163491 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.163491 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.163813 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.163973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.164123 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.164274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.164423 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.164581 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.164744 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.164895 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.165045 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.165204 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.165361 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.165521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.165682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.165905 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.166079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.166079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.166419 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.166653 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.166816 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.166975 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.167737 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.167902 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.168063 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.168227 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.168378 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.168528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.168685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.168849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.169020 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.169178 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.169330 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.169480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.169631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.169985 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.170154 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.170509 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.170671 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.170830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.170985 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.171489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.171649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.171816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.171976 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.172168 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.172953 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.173113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.173265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.173624 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.173792 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.173954 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174143 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174233 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174308 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174634 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174715 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174797 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.174957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175262 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175342 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175414 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175484 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175569 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175642 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175712 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175788 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175860 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.175939 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176020 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176092 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176306 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176306 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176455 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176739 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176862 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.176951 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177103 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177174 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177244 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177328 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177407 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177486 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177559 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177630 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177700 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177783 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177857 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.177934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.178248 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.178649 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.178737 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.178811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.178883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179202 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179297 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179372 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179444 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179514 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179600 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179679 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179752 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179823 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179901 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.179972 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180060 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180199 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180354 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180518 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180598 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180749 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180820 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180897 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.180968 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.181048 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.181121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.181121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.181631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.181786 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.181883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.181988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182109 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182184 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182256 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182351 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182447 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182608 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182695 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182767 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.182843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183174 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183261 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183335 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183414 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183493 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183739 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183739 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183882 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.183960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.184046 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.184120 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.184197 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.184276 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.184348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.184418 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.184497 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.184683 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.185118 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.185219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.185295 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.185366 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.185447 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.185745 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.185854 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.185937 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.186017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.186288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.186492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.186651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.186802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.186974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.187272 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.187364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.187439 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.187678 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.187792 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.188166 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.188265 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.188701 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.188819 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.188959 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.189037 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.189234 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.189340 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.189743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.189849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.190104 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.190203 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.197215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.197406 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.197582 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.197746 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.197899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.198058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.198218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.198459 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.198638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.198790 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.198966 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.199241 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.199421 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.199583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.199734 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.199889 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.200039 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.200190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.200341 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.200504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.200661 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.200830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.200980 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.201136 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.201297 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.201461 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.201617 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.201767 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.201916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.202065 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.202222 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.202399 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.202399 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.202730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.202891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.203041 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.203041 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.203340 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.203340 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.203993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.204206 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.204372 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.204535 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.205134 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.205304 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.205457 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.205622 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.205787 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.205939 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.206096 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.206255 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.206475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.206878 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.207057 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.207210 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.207375 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.207538 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.207538 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.207840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.208011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.208162 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.208320 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.208478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.208635 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.208787 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.208946 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.209099 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.209255 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.209414 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.209587 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.209759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.209759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.210058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.210058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.210380 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.210537 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.210696 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.210849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.210998 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.211148 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.211305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.211650 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.211824 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.211977 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.212148 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.212299 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.212449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.212607 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.212758 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.212909 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.213058 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.213215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.213366 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.213529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.213680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.213836 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.213999 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.214149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.214299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.214490 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.214642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.214816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.215379 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.215532 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.215683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.215842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.216002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.216161 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.216312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.216477 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.216642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.216800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.216800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.217094 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.217256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.217414 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.217579 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.217729 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.217729 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.218030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.218189 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.218360 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.218539 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.218692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.218692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.218983 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.219755 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.219983 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.220158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.220320 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.220472 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.220622 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.220771 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.221002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.221156 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.221318 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.221476 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.221635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.221803 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.222114 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.222278 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.222543 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.222696 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.222857 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.223008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.223008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.223312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.223481 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.223639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.223797 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.223962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.224119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.224278 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.224435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.224594 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.224743 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.224907 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.225487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.225656 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.225808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.226595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.226755 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.227159 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.227322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.227485 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.227652 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.227815 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.228028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.228254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.228471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.228642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.228815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.228975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.229133 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.229284 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.229435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.229599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.229751 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.229901 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.230058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.230058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.230401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.230401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.230723 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.230894 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.231047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.231197 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.231355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.231513 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.231664 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.231814 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.231964 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.232115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.232275 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.232427 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.232632 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.232806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.232960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.232960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.233254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.233405 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.233562 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.233720 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.233878 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.234029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.234193 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.234406 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.234573 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.234803 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.234977 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.235704 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.235869 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.236053 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.236214 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.236373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.236532 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.236693 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.236844 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.237002 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.237153 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.237310 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.237479 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.237649 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.237801 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.237952 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.238103 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.238252 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.238444 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.238605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.238756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.238913 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.238913 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.239209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.239369 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.239369 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.239664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240317 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240477 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240585 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:49:09.240684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.240684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.241579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.241579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.241579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.241579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.241579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.241579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.241579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.241579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.242442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.242442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.242442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.242442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.242442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.242442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.242442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.243916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.244730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.244730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.244933 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.245279 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.245610 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.245928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.246242 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.246588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.246905 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.247218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.247548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.247866 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.248182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.248511 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.248827 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.249479 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.249754 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.250082 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.250978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.251697 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.251862 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.252079 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.252408 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.252721 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.253032 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.253356 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.253672 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.253981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.254294 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.254646 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.254962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.255273 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.255583 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.255898 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.256231 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.256546 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.256858 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.257169 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.257487 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.257797 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.258110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.258461 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.258780 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.259099 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.259433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.260346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.260346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.260346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.260745 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.260962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.261324 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.261653 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.261965 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.262275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.262619 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.262938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.263269 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.263590 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.263908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.264265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.264587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.265139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.265483 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.265825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.266610 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.266941 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.267259 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.267710 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.267884 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.268219 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.268538 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.269065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.269217 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.269500 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.269821 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.270137 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.270480 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.270800 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.271118 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.271435 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.271751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.272067 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.272385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.272706 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.273054 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.273380 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.273704 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.274024 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.274363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.274687 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.275005 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.275320 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.275635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.275957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.276294 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.276612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.276928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.277450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.277768 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.278095 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.278444 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.278769 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.279096 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.279426 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.279744 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.280072 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.280388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.280722 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.281067 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.281403 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.282665 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.282665 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.282988 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.283299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.283613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.283940 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.284258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.284568 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.284878 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.285192 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.285503 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.285851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.286120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.286456 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.286772 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.287081 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.287392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.287701 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.288011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.288323 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.288633 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.288946 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.289261 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.289570 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.289880 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.290668 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.290668 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.290944 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.291683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.291683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.291957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.292088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.292419 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.292737 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.292883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO dbcounter [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Registered counter for database nova_api Jun 23 10:49:09.293068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.293394 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.293714 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.294031 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.294394 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.294713 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.295033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.295349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.295666 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.295983 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.296298 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.296627 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.296958 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.298266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.298266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.298632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.298804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.299132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.299447 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.299783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.300101 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.300417 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.300736 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.301051 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.301366 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.301684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.302006 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.302356 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.302691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.303007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.303335 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.303664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.304015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.304333 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.304680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.305014 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.305334 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.305651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.305962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:49:09.306211 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:49:09.313947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_db.sqlalchemy.engines [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:49:09.320645 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writer thread running {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:49:09.371530 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO dbcounter [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Registered counter for database nova_api Jun 23 10:49:09.377141 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.context [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fbacf08-c442-40fa-9217-0ac16ded2d58(cell1) {{(pid=129461) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 10:49:09.381208 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:49:09.382808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:49:09.383602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:49:09.385550 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:49:09.387556 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO dbcounter [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Registered counter for database nova_cell0 Jun 23 10:49:09.391626 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_db.sqlalchemy.engines [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:49:09.391829 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO dbcounter [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Registered counter for database nova_cell1 Jun 23 10:49:09.398106 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writer thread running {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:49:09.399449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_db.sqlalchemy.engines [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:49:09.400654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_db.sqlalchemy.engines [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:49:09.407812 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writer thread running {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:49:09.409899 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writer thread running {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:49:09.455269 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.context [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fbacf08-c442-40fa-9217-0ac16ded2d58(cell1) {{(pid=129460) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 10:49:09.459366 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:49:09.460950 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:49:09.461756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:49:09.463736 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:49:09.465698 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO dbcounter [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Registered counter for database nova_cell0 Jun 23 10:49:09.470369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO dbcounter [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Registered counter for database nova_cell1 Jun 23 10:49:09.477429 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_db.sqlalchemy.engines [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:49:09.479661 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_db.sqlalchemy.engines [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:49:09.485287 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writer thread running {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:49:09.487384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writer thread running {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:49:09.558425 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO dbcounter [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Registered counter for database nova_cell0 Jun 23 10:49:09.565747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_db.sqlalchemy.engines [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:49:09.570045 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writer thread running {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:49:09.637340 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO dbcounter [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Registered counter for database nova_cell0 Jun 23 10:49:09.644514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_db.sqlalchemy.engines [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:49:09.648886 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writer thread running {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:49:09.896041 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: WARNING keystonemiddleware.auth_token [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:49:09.903193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: WARNING keystonemiddleware.auth_token [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:49:09.972605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: WARNING keystonemiddleware.auth_token [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:49:09.979915 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: WARNING keystonemiddleware.auth_token [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:49:10.251113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: WARNING keystonemiddleware.auth_token [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:49:10.257260 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: WARNING keystonemiddleware.auth_token [None req-639f2c90-0bb6-424e-ae68-3c4300c1b333 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:49:10.262811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a869ada9c0 pid: 129461 (default app) Jun 23 10:49:10.332328 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: WARNING keystonemiddleware.auth_token [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:49:10.338310 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: WARNING keystonemiddleware.auth_token [None req-2e4df751-8669-4832-a451-94b9adb3e55e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:49:10.343682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a869ada9c0 pid: 129460 (default app) Jun 23 10:49:51.759263 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.761194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.762542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.763720 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.770457 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=3 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.771670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=3 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.772405 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=3 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.775674 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=3 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:52.575565 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5fce2561-acd4-4c59-951d-4e9e37fabc53 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Action: 'create', calling method: .version_select at 0x7f8dcb258700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2127598885", "metadata": {"Type": "work"}}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5fce2561-acd4-4c59-951d-4e9e37fabc53 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Request method failure captured: Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 122 Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVPNmRhseUrfe9Wv2NRjuJN_Xvzk_6qjidoY81MqDnaYpZtkcYaNBe_n5gQ2eigD27qr-DqKEyUdaiX6K2W7D5mIiGpedrm3lb0fwPpkHQjufiCx8wrQrKJ7pCQ5DxRvAS6kb7CdSQgpaDwQTfK1cxP8fStm5dk7jT_8hU2t6pP1z8 Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:49:52.598672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35949285b2344805a597b6c9842f47e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35949285b2344805a597b6c9842f47e8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: c00c6a789b9742c08769e391656b3b72 Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2127598885", "metadata": {"Type": "work"}}} Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: Jun 23 10:49:52.600131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2127598885', 'metadata': {'Type': 'work'}}}} Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise error Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:49:52.600963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 10:49:52.607760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 10:49:52.611069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 10:49:52.611069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.611069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5fce2561-acd4-4c59-951d-4e9e37fabc53 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:49:52.611069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5fce2561-acd4-4c59-951d-4e9e37fabc53 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.860156 Jun 23 10:49:52.611069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Thu Jun 23 10:49:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 863 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 10:49:52.613405 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f6bc9a23-f129-4b51-9d9c-319e0b4dee4f tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Action: 'create', calling method: .version_select at 0x7f8dcb16ca60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-851555506", "metadata": {"Type": "work"}}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f6bc9a23-f129-4b51-9d9c-319e0b4dee4f tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Request method failure captured: Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 119 Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVPNmRhseUrfe9Wv2NRjuJN_Xvzk_6qjidoY81MqDnaYpZtkcYaNBe_n5gQ2eigD27qr-DqKEyUdaiX6K2W7D5mIiGpedrm3lb0fwPpkHQjufiCx8wrQrKJ7pCQ5DxRvAS6kb7CdSQgpaDwQTfK1cxP8fStm5dk7jT_8hU2t6pP1z8 Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:49:52.618504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35949285b2344805a597b6c9842f47e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35949285b2344805a597b6c9842f47e8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: c00c6a789b9742c08769e391656b3b72 Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-851555506", "metadata": {"Type": "work"}}} Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: Jun 23 10:49:52.620127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-851555506', 'metadata': {'Type': 'work'}}}} Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise error Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi '0' Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:49:52.621049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 10:49:52.623945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 10:49:52.625528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 10:49:52.625528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.625528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f6bc9a23-f129-4b51-9d9c-319e0b4dee4f tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:49:52.625528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f6bc9a23-f129-4b51-9d9c-319e0b4dee4f tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011921 Jun 23 10:49:52.625528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 2/2] 10.222.0.39 () {60 vars in 1155 bytes} [Thu Jun 23 10:49:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 10:49:52.633065 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-dcaafe50-a11c-4e43-97ae-da03acdafd1a tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Action: 'create', calling method: .version_select at 0x7f8dcb258700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-426696277", "metadata": {"Type": "work"}}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-dcaafe50-a11c-4e43-97ae-da03acdafd1a tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Request method failure captured: Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 118 Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVPNmRhseUrfe9Wv2NRjuJN_Xvzk_6qjidoY81MqDnaYpZtkcYaNBe_n5gQ2eigD27qr-DqKEyUdaiX6K2W7D5mIiGpedrm3lb0fwPpkHQjufiCx8wrQrKJ7pCQ5DxRvAS6kb7CdSQgpaDwQTfK1cxP8fStm5dk7jT_8hU2t6pP1z8 Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:49:52.635938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35949285b2344805a597b6c9842f47e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35949285b2344805a597b6c9842f47e8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: c00c6a789b9742c08769e391656b3b72 Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-426696277", "metadata": {"Type": "work"}}} Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: Jun 23 10:49:52.637545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-426696277', 'metadata': {'Type': 'work'}}}} Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise error Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi '' Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:49:52.638536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 10:49:52.640169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 10:49:52.641600 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 10:49:52.641600 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.641600 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-dcaafe50-a11c-4e43-97ae-da03acdafd1a tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:49:52.652625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-dcaafe50-a11c-4e43-97ae-da03acdafd1a tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023762 Jun 23 10:49:52.660049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 3/3] 10.222.0.39 () {60 vars in 1155 bytes} [Thu Jun 23 10:49:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 10:49:52.668255 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d8f6cbbf-412c-4477-ad2f-1506535ab9bf tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Calling method '.version_select at 0x7f8dcb100790>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:52.840490 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6ced25af-478c-45c7-93be-854bfb12eb07 tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] Action: 'create', calling method: .version_select at 0x7f8dcb257700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-620377394", "metadata": {"Type": "work"}}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:49:52.893290 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-d8f6cbbf-412c-4477-ad2f-1506535ab9bf tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] HTTP exception thrown: Volume tempest-invalid-1543105464 could not be found. Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d8f6cbbf-412c-4477-ad2f-1506535ab9bf tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Request method failure captured: Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1543105464 HTTP/1.1 Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVPNmRhseUrfe9Wv2NRjuJN_Xvzk_6qjidoY81MqDnaYpZtkcYaNBe_n5gQ2eigD27qr-DqKEyUdaiX6K2W7D5mIiGpedrm3lb0fwPpkHQjufiCx8wrQrKJ7pCQ5DxRvAS6kb7CdSQgpaDwQTfK1cxP8fStm5dk7jT_8hU2t6pP1z8 Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:49:52.912957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35949285b2344805a597b6c9842f47e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35949285b2344805a597b6c9842f47e8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: c00c6a789b9742c08769e391656b3b72 Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Volume tempest-invalid-1543105464 could not be found. Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': 'tempest-invalid-1543105464'} Jun 23 10:49:52.914620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1543105464 could not be found. (HTTP 404) (Request-ID: req-e789eefb-4ec3-43cb-9e79-7430b896c0e0) Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:52.915449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 10:49:52.916806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1543105464 could not be found. Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:49:52.918081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1543105464 could not be found. Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1543105464 could not be found. Jun 23 10:49:52.921043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:52.925237 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d8f6cbbf-412c-4477-ad2f-1506535ab9bf tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Returning 404 to user: Volume tempest-invalid-1543105464 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:49:52.928222 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d8f6cbbf-412c-4477-ad2f-1506535ab9bf tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1543105464" status: 404 len: 99 microversion: 2.1 time: 0.263948 Jun 23 10:49:52.930835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 4/4] 10.222.0.39 () {58 vars in 1217 bytes} [Thu Jun 23 10:49:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1543105464 => generated 99 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 23 10:49:52.945513 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-23cd7943-ce0f-48b2-8305-6f67eabf20ae tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008886 Jun 23 10:49:52.949878 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 5/5] 10.222.0.39 () {58 vars in 1139 bytes} [Thu Jun 23 10:49:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 23 10:49:52.963826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9ae8ceb0-c3d5-45ab-a9a8-e36481815d49 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007121 Jun 23 10:49:52.964834 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 6/6] 10.222.0.39 () {58 vars in 1136 bytes} [Thu Jun 23 10:49:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 23 10:49:52.983639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d5a55214-ee29-419c-9b0b-ba602e235d5d tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Calling method '.version_select at 0x7f8dcb0b1a60>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:53.670242 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-d5a55214-ee29-419c-9b0b-ba602e235d5d tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] HTTP exception thrown: Volume 6cd28ade-c92e-441b-b392-c4f7ba989280 could not be found. Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d5a55214-ee29-419c-9b0b-ba602e235d5d tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Request method failure captured: Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/os-volumes/6cd28ade-c92e-441b-b392-c4f7ba989280 HTTP/1.1 Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVPNmRhseUrfe9Wv2NRjuJN_Xvzk_6qjidoY81MqDnaYpZtkcYaNBe_n5gQ2eigD27qr-DqKEyUdaiX6K2W7D5mIiGpedrm3lb0fwPpkHQjufiCx8wrQrKJ7pCQ5DxRvAS6kb7CdSQgpaDwQTfK1cxP8fStm5dk7jT_8hU2t6pP1z8 Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:49:53.674816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35949285b2344805a597b6c9842f47e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35949285b2344805a597b6c9842f47e8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: c00c6a789b9742c08769e391656b3b72 Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Volume 6cd28ade-c92e-441b-b392-c4f7ba989280 could not be found. Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '6cd28ade-c92e-441b-b392-c4f7ba989280'} Jun 23 10:49:53.676508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6cd28ade-c92e-441b-b392-c4f7ba989280 could not be found. (HTTP 404) (Request-ID: req-911cb6a3-9917-4434-9c8f-fe3396209645) Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:53.677617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 10:49:53.678747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6cd28ade-c92e-441b-b392-c4f7ba989280 could not be found. Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 10:49:53.680034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6cd28ade-c92e-441b-b392-c4f7ba989280 could not be found. Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6cd28ade-c92e-441b-b392-c4f7ba989280 could not be found. Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d5a55214-ee29-419c-9b0b-ba602e235d5d tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Returning 404 to user: Volume 6cd28ade-c92e-441b-b392-c4f7ba989280 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d5a55214-ee29-419c-9b0b-ba602e235d5d tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/6cd28ade-c92e-441b-b392-c4f7ba989280" status: 404 len: 109 microversion: 2.1 time: 0.698369 Jun 23 10:49:53.681107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 7/7] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 10:49:52 2022] DELETE /compute/v2.1/os-volumes/6cd28ade-c92e-441b-b392-c4f7ba989280 => generated 109 bytes in 700 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:49:53.706126 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-daf78c28-f343-4be8-99bc-0ad61ce3bdf1 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Calling method '.version_select at 0x7f8dcb0b15e0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:53.887810 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6ced25af-478c-45c7-93be-854bfb12eb07 tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.124143 Jun 23 10:49:53.888440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 1/8] 10.222.0.39 () {60 vars in 1155 bytes} [Thu Jun 23 10:49:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2126 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 10:49:53.894434 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2f3e203f-cfb0-4bc1-b934-4e7173eec91e tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb11c550>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:53.960357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-daf78c28-f343-4be8-99bc-0ad61ce3bdf1 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] HTTP exception thrown: Volume 14efe529-5497-4693-bdfd-7b0aa8aaefc2 could not be found. Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-daf78c28-f343-4be8-99bc-0ad61ce3bdf1 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Request method failure captured: Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/os-volumes/14efe529-5497-4693-bdfd-7b0aa8aaefc2 HTTP/1.1 Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVPNmRhseUrfe9Wv2NRjuJN_Xvzk_6qjidoY81MqDnaYpZtkcYaNBe_n5gQ2eigD27qr-DqKEyUdaiX6K2W7D5mIiGpedrm3lb0fwPpkHQjufiCx8wrQrKJ7pCQ5DxRvAS6kb7CdSQgpaDwQTfK1cxP8fStm5dk7jT_8hU2t6pP1z8 Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:49:53.963006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35949285b2344805a597b6c9842f47e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35949285b2344805a597b6c9842f47e8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35949285b2344805a597b6c9842f47e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 35949285b2344805a597b6c9842f47e8 Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesNegativeTest-1287624458 Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: c00c6a789b9742c08769e391656b3b72 Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesNegativeTest-1287624458-project Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Volume 14efe529-5497-4693-bdfd-7b0aa8aaefc2 could not be found. Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '14efe529-5497-4693-bdfd-7b0aa8aaefc2'} Jun 23 10:49:53.964287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14efe529-5497-4693-bdfd-7b0aa8aaefc2 could not be found. (HTTP 404) (Request-ID: req-8f64113d-8a18-423e-a82d-87d653e6a044) Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:53.965083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 10:49:53.966220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14efe529-5497-4693-bdfd-7b0aa8aaefc2 could not be found. Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 10:49:53.967401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14efe529-5497-4693-bdfd-7b0aa8aaefc2 could not be found. Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14efe529-5497-4693-bdfd-7b0aa8aaefc2 could not be found. Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-daf78c28-f343-4be8-99bc-0ad61ce3bdf1 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] Returning 404 to user: Volume 14efe529-5497-4693-bdfd-7b0aa8aaefc2 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-daf78c28-f343-4be8-99bc-0ad61ce3bdf1 tempest-VolumesNegativeTest-1287624458 tempest-VolumesNegativeTest-1287624458-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/14efe529-5497-4693-bdfd-7b0aa8aaefc2" status: 404 len: 109 microversion: 2.1 time: 0.279176 Jun 23 10:49:53.975872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 8/9] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 10:49:53 2022] GET /compute/v2.1/os-volumes/14efe529-5497-4693-bdfd-7b0aa8aaefc2 => generated 109 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:49:54.010766 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-385da3f1-0bb8-4945-82cd-4595b9932445 tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] Calling method '.version_select at 0x7f8dcb16cdc0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:54.126045 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2f3e203f-cfb0-4bc1-b934-4e7173eec91e tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0d599ee8-0582-4742-8da2-4017860bf8c3" status: 200 len: 351 microversion: 2.1 time: 0.236143 Jun 23 10:49:54.126865 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 2/10] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 10:49:53 2022] GET /compute/v2.1/os-volumes/0d599ee8-0582-4742-8da2-4017860bf8c3 => generated 351 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:49:54.204806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-385da3f1-0bb8-4945-82cd-4595b9932445 tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042" status: 200 len: 352 microversion: 2.1 time: 0.237888 Jun 23 10:49:54.206342 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 9/11] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 10:49:53 2022] GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042 => generated 352 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:49:55.218895 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cd2a999a-f303-4b3c-8926-5887e9188333 tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] Calling method '.version_select at 0x7f8dcb11c700>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:55.326563 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-cd2a999a-f303-4b3c-8926-5887e9188333 tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042" status: 200 len: 353 microversion: 2.1 time: 0.111378 Jun 23 10:49:55.327126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 3/12] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 10:49:55 2022] GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:49:55.339062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b774f2fa-6e38-4217-9128-508d8c1d312f tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] Calling method '.version_select at 0x7f8dcb1001f0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:55.488562 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b774f2fa-6e38-4217-9128-508d8c1d312f tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042" status: 200 len: 353 microversion: 2.1 time: 0.153333 Jun 23 10:49:55.489427 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 10/13] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 10:49:55 2022] GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:49:55.507495 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0507cb10-8a8d-4371-86d5-07948bc04dad tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] Calling method '.version_select at 0x7f8dcb11cd30>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:55.825182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-443df8da-eea3-4bb0-bcb7-770f6ceb2a6d tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb0b1820>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:55.902933 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0507cb10-8a8d-4371-86d5-07948bc04dad tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042" status: 202 len: 0 microversion: 2.1 time: 0.399225 Jun 23 10:49:55.903546 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 4/14] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 10:49:55 2022] DELETE /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:49:55.913116 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6ccbf542-c967-44b9-bffd-b4acdb387b68 tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] Calling method '.version_select at 0x7f8dcb0b5430>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:55.945021 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-443df8da-eea3-4bb0-bcb7-770f6ceb2a6d tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/de2c87ec-cb93-4b0e-92a7-a8d42bdf9bc1" status: 200 len: 351 microversion: 2.1 time: 0.129148 Jun 23 10:49:55.947256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 11/15] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 10:49:55 2022] GET /compute/v2.1/os-volumes/de2c87ec-cb93-4b0e-92a7-a8d42bdf9bc1 => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:49:56.033708 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6ccbf542-c967-44b9-bffd-b4acdb387b68 tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042" status: 200 len: 352 microversion: 2.1 time: 0.124648 Jun 23 10:49:56.035008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 5/16] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 10:49:55 2022] GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:49:57.046936 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6b8ee7e0-7588-4111-a28a-dd8eac67355b tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] Calling method '.version_select at 0x7f8dcb0440d0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:57.205074 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-6b8ee7e0-7588-4111-a28a-dd8eac67355b tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] HTTP exception thrown: Volume 6b80fd0b-7103-47a4-8e26-5afbf3282042 could not be found. Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6b8ee7e0-7588-4111-a28a-dd8eac67355b tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] Request method failure captured: Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042 HTTP/1.1 Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVPrPAKMdu1TFkRw1SQTozpp4M0YvqjEs-LaRJSh8W06jzoY6N3nzLDr8S4_5Sd9bSCiXnRRwjqYYLF1SPZl70HzPV1P8LAjMknQpWZLueg7keg5egd5k31NkqxqcI70yXMgZ8Mat545jOPgkQr_WA3sgcSpOAss0ku0YAJEo23maM Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 43f9a4e53da6457a83ea4600c865fc50 Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesGetTestJSON-1336750930 Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:49:57.218966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/43f9a4e53da6457a83ea4600c865fc50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/43f9a4e53da6457a83ea4600c865fc50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_43f9a4e53da6457a83ea4600c865fc50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/43f9a4e53da6457a83ea4600c865fc50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesGetTestJSON-1336750930 Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 43f9a4e53da6457a83ea4600c865fc50 Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesGetTestJSON-1336750930 Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesGetTestJSON-1336750930-project Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: be279191d67b41b488ef8862d16ba6cf Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesGetTestJSON-1336750930-project Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Volume 6b80fd0b-7103-47a4-8e26-5afbf3282042 could not be found. Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '6b80fd0b-7103-47a4-8e26-5afbf3282042'} Jun 23 10:49:57.220324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b80fd0b-7103-47a4-8e26-5afbf3282042 could not be found. (HTTP 404) (Request-ID: req-48362182-d437-4a85-8f1c-5c1b055eaf76) Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:57.221104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 10:49:57.222215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b80fd0b-7103-47a4-8e26-5afbf3282042 could not be found. Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 10:49:57.224121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b80fd0b-7103-47a4-8e26-5afbf3282042 could not be found. Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b80fd0b-7103-47a4-8e26-5afbf3282042 could not be found. Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6b8ee7e0-7588-4111-a28a-dd8eac67355b tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] Returning 404 to user: Volume 6b80fd0b-7103-47a4-8e26-5afbf3282042 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6b8ee7e0-7588-4111-a28a-dd8eac67355b tempest-VolumesGetTestJSON-1336750930 tempest-VolumesGetTestJSON-1336750930-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042" status: 404 len: 109 microversion: 2.1 time: 0.178271 Jun 23 10:49:57.225394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 12/17] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 10:49:57 2022] GET /compute/v2.1/os-volumes/6b80fd0b-7103-47a4-8e26-5afbf3282042 => generated 109 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:49:57.693340 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-40e6a4f4-4a87-44b0-ad63-5f86ef2ad26f tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb11cca0>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:57.959493 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-40e6a4f4-4a87-44b0-ad63-5f86ef2ad26f tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/68037e69-30ad-43ef-b008-3e9ecb805330" status: 200 len: 349 microversion: 2.1 time: 0.272280 Jun 23 10:49:57.960783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 6/18] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 10:49:57 2022] GET /compute/v2.1/os-volumes/68037e69-30ad-43ef-b008-3e9ecb805330 => generated 349 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:49:57.974047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0ce34981-8be0-4960-8d51-a51fb3efb4ce tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb0b1c10>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:58.267198 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0ce34981-8be0-4960-8d51-a51fb3efb4ce tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.299016 Jun 23 10:49:58.268233 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 13/19] 10.222.0.39 () {58 vars in 1133 bytes} [Thu Jun 23 10:49:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:58.284613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cb5705df-2aff-444e-b0fc-6ea4b6726747 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb11c790>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:58.613352 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-cb5705df-2aff-444e-b0fc-6ea4b6726747 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.334735 Jun 23 10:49:58.628801 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 7/20] 10.222.0.39 () {58 vars in 1148 bytes} [Thu Jun 23 10:49:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:49:58.653819 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-33956bf9-c585-4616-b4f9-c5ccfdbb5418 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb0444c0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:58.896306 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-33956bf9-c585-4616-b4f9-c5ccfdbb5418 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.256713 Jun 23 10:49:58.904339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 14/21] 10.222.0.39 () {58 vars in 1133 bytes} [Thu Jun 23 10:49:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:58.914359 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-49208576-2f4f-4440-8660-eeab0ab38d73 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb0b5a60>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:59.146341 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-49208576-2f4f-4440-8660-eeab0ab38d73 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.240643 Jun 23 10:49:59.146904 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 8/22] 10.222.0.39 () {58 vars in 1166 bytes} [Thu Jun 23 10:49:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:49:59.162084 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7ad1c398-8cde-4428-b048-86af4c8e9f2d tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb0b1550>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:59.405297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7ad1c398-8cde-4428-b048-86af4c8e9f2d tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.248558 Jun 23 10:49:59.414534 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 15/23] 10.222.0.39 () {58 vars in 1169 bytes} [Thu Jun 23 10:49:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:49:59.427213 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a4705330-3d80-49e9-9fda-e9a16dc84c66 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb0b5e50>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:59.609712 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a4705330-3d80-49e9-9fda-e9a16dc84c66 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.193551 Jun 23 10:49:59.611290 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 9/24] 10.222.0.39 () {58 vars in 1154 bytes} [Thu Jun 23 10:49:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:49:59.622200 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c86c8881-7145-4736-9561-418b87697cd6 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb044670>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:49:59.897187 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c86c8881-7145-4736-9561-418b87697cd6 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.278571 Jun 23 10:49:59.908676 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 16/25] 10.222.0.39 () {58 vars in 1187 bytes} [Thu Jun 23 10:49:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:49:59.914151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-43d5fa80-0500-4308-9d85-e442ff38ff14 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] Calling method '.version_select at 0x7f8dcb0b5430>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:00.107075 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-43d5fa80-0500-4308-9d85-e442ff38ff14 tempest-VolumesTestJSON-796152121 tempest-VolumesTestJSON-796152121-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.197497 Jun 23 10:50:00.107919 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 10/26] 10.222.0.39 () {58 vars in 1154 bytes} [Thu Jun 23 10:49:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:07.126827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-10f4e82e-e516-4c40-9578-a9da3e8646c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'create', calling method: .version_select at 0x7f8dcb044f70>, body: {"keypair": {"name": "tempest-keypair-496390611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJjwqYIJvEeRefg0o/jAibrmfmTS3CTgOGNPrwz1hgNDJWZLQ23tE8CfO+spn47n5ryIpdENjo6d2YBsRAXphkd8ww78ppmznCwLuQnfdtUkRJbSeNdRa/wB1y4psE9RQ=="}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:07.265054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-10f4e82e-e516-4c40-9578-a9da3e8646c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Getting quotas for project 11861d35a3444734be8870f47cce1b9b. Resources: {'key_pairs'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:50:07.282499 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-10f4e82e-e516-4c40-9578-a9da3e8646c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Getting quotas for user b0b95c321c4a452faa81a93168c7bf0a and project 11861d35a3444734be8870f47cce1b9b. Resources: {'key_pairs'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:50:07.368758 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-10f4e82e-e516-4c40-9578-a9da3e8646c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.866432 Jun 23 10:50:07.370169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 17/27] 10.222.0.39 () {62 vars in 1199 bytes} [Thu Jun 23 10:50:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 868 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:09.321238 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e62c5a26-f13b-46cb-87b2-a255c66b5d19 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: .version_select at 0x7f8dcb11cf70>, body: {"keypair": {"name": "tempest-keypair-1439996733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCJy6iF4CG5fOeEsxQ2Yk5AGerXpRsAk9tBao6ZX1SMDkTm28gg7QGahALjNxcHmTEChvNqjPYShfNvkOEVK/33w9nkyVqYoWxPsa00bPZHQ22vGVYT/cRsxyAqc39Sew=="}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:09.443220 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-e62c5a26-f13b-46cb-87b2-a255c66b5d19 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for project 2123ff10502044b9aea48720440c2291. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:50:09.457658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-e62c5a26-f13b-46cb-87b2-a255c66b5d19 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for user eb8df5670686403480cdfd32ac408945 and project 2123ff10502044b9aea48720440c2291. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:50:09.483047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1689122351", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "networks": [{"uuid": "0463d6d8-2807-485d-b81b-ef7d13b4c568"}]}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:09.572084 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e62c5a26-f13b-46cb-87b2-a255c66b5d19 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.011457 Jun 23 10:50:09.580598 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 11/28] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 10:50:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:50:09.671860 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] validate_networks() for [('0463d6d8-2807-485d-b81b-ef7d13b4c568', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:50:10.834465 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-846240213", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:11.008151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.network.neutron [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] validate_networks() for [('336b121a-ed5e-44ff-8b8f-ca20d4537d74', None, None, None, None, None)] {{(pid=129460) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:50:12.201921 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:50:12.203040 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:50:12.203465 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:50:12.204211 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:50:12.204652 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:50:12.236357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:12.240028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:12.241147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:12.243669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:12.318987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Getting quotas for project b14d176a6ae64d38905e5bd43c97c253. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:50:12.340552 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Getting quotas for user b982efb5297246ccbf6515cf7bc9dde5 and project b14d176a6ae64d38905e5bd43c97c253. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:50:12.379332 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:50:12.391700 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:50:12.542111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fe465f60-63c0-46cc-9eb5-88eb8fb1096d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.877285 Jun 23 10:50:12.544387 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 18/29] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:50:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:50:12.551395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-156661404", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a2d2fa8-1b72-4e3b-a7e9-7705374b5eb3"}], "security_groups": [{"name": "tempest-securitygroup--1230288277"}], "key_name": "tempest-keypair-496390611", "user_data": "}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:13.101342 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] validate_networks() for [('5a2d2fa8-1b72-4e3b-a7e9-7705374b5eb3', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:50:13.659995 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Flavor limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:50:13.660592 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Image limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:50:13.661243 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Flavor pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:50:13.661657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Image pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:50:13.662992 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:50:13.696307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:13.696790 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:13.718996 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:13.719488 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:13.842571 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Getting quotas for project eacce04e67d14a2f8ae63f5cd115b69c. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:50:13.865856 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Getting quotas for user d230950f9e984a8b878d7d0f74dda3ce and project eacce04e67d14a2f8ae63f5cd115b69c. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:50:13.912635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Going to run 1 instances... {{(pid=129460) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:50:13.922557 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129460) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:50:14.172011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4a684f93-8952-462d-ab66-1ae42bf5df9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.311201 Jun 23 10:50:14.175521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 12/30] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:50:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 4330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:50:14.187436 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-74f4fa1b-facc-4b74-8bc3-d1868a3b540c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:14.189633 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-74f4fa1b-facc-4b74-8bc3-d1868a3b540c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:15.063912 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-74f4fa1b-facc-4b74-8bc3-d1868a3b540c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:15.096163 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-74f4fa1b-facc-4b74-8bc3-d1868a3b540c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1215 microversion: 2.1 time: 0.919340 Jun 23 10:50:15.105266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 13/31] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:14 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1215 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:15.122056 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a2c589a7-8aac-48b0-b706-4a00ca40c5fd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:15.124653 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a2c589a7-8aac-48b0-b706-4a00ca40c5fd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:15.369315 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a2c589a7-8aac-48b0-b706-4a00ca40c5fd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:15.382182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a2c589a7-8aac-48b0-b706-4a00ca40c5fd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1221 microversion: 2.1 time: 0.275381 Jun 23 10:50:15.382806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 14/32] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:15 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1221 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:15.400885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-743844874", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66f9eed7-b9a6-4658-b62c-bb41bfa6807b"}], "security_groups": [{"name": "tempest-securitygroup--1058268733"}], "key_name": "tempest-keypair-1439996733", "user_data": "}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:15.462431 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:50:15.463611 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:50:15.464185 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:50:15.464597 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:50:15.465013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:50:15.491312 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:15.491761 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:15.492569 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:15.493007 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:15.587916 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Getting quotas for project 11861d35a3444734be8870f47cce1b9b. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:50:15.602789 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Getting quotas for user b0b95c321c4a452faa81a93168c7bf0a and project 11861d35a3444734be8870f47cce1b9b. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:50:15.633465 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.network.neutron [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] validate_networks() for [('66f9eed7-b9a6-4658-b62c-bb41bfa6807b', None, None, None, None, None)] {{(pid=129460) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:50:15.665284 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:50:15.668584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:50:15.871116 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8f027a44-99c6-4e00-8752-28cb7808756c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.325268 Jun 23 10:50:15.878954 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 19/33] 10.222.0.39 () {62 vars in 1187 bytes} [Thu Jun 23 10:50:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 10:50:15.884203 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1354431955", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:16.053147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] validate_networks() for [('336b121a-ed5e-44ff-8b8f-ca20d4537d74', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:50:17.674198 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Flavor limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:50:17.674708 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Image limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:50:17.675411 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Flavor pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:50:17.675512 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Image pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:50:17.675907 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:50:17.687906 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:17.688562 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:17.689723 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:17.694588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:17.725297 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for project 2123ff10502044b9aea48720440c2291. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:50:17.729113 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for user eb8df5670686403480cdfd32ac408945 and project 2123ff10502044b9aea48720440c2291. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:50:17.744412 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Going to run 1 instances... {{(pid=129460) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:50:17.752248 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129460) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:50:17.850240 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3764cdc6-8f67-48f4-8ce3-5bc75ec16842 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.464316 Jun 23 10:50:17.851229 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 15/34] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:50:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:50:17.856275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:17.857173 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:17.864753 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:17.865521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:17.866540 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:17.867195 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:17.933133 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:50:17.933638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:50:17.934347 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:50:17.936038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:50:17.936038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:50:17.956746 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:17.957838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:17.959572 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:17.960595 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:18.001512 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Getting quotas for project eacce04e67d14a2f8ae63f5cd115b69c. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:50:18.007048 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Getting quotas for user d230950f9e984a8b878d7d0f74dda3ce and project eacce04e67d14a2f8ae63f5cd115b69c. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:50:18.021905 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:50:18.024235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:50:18.107333 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4baf5ea9-10c3-4f90-9c3f-069d093ec87d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.227217 Jun 23 10:50:18.108527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 20/35] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:50:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:50:18.113375 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2ec495e4-876d-4c03-a998-f08d56bfc3f4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:18.114016 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2ec495e4-876d-4c03-a998-f08d56bfc3f4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:18.139308 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2ec495e4-876d-4c03-a998-f08d56bfc3f4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:18.140639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2ec495e4-876d-4c03-a998-f08d56bfc3f4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:18.141670 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2ec495e4-876d-4c03-a998-f08d56bfc3f4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:18.142257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2ec495e4-876d-4c03-a998-f08d56bfc3f4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:18.159225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:18.205552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:18.207207 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:18.208353 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-67a59df7-9eac-4e34-a2dc-d4dab71b7e20 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1276 microversion: 2.20 time: 0.355994 Jun 23 10:50:18.208911 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 16/36] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:17 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1276 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:18.227099 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8487b3ea-b710-49f8-a9bc-ef06a79c4cdf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:18.227716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8487b3ea-b710-49f8-a9bc-ef06a79c4cdf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:18.371379 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8487b3ea-b710-49f8-a9bc-ef06a79c4cdf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:18.394989 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8487b3ea-b710-49f8-a9bc-ef06a79c4cdf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1241 microversion: 2.1 time: 0.172837 Jun 23 10:50:18.404835 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 17/37] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:18 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1241 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:18.410728 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-335fa470-54e9-4417-b760-444f0c0973c0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:18.412822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-335fa470-54e9-4417-b760-444f0c0973c0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:18.435169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2ec495e4-876d-4c03-a998-f08d56bfc3f4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:18.465777 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2ec495e4-876d-4c03-a998-f08d56bfc3f4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1285 microversion: 2.1 time: 0.356019 Jun 23 10:50:18.476904 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 21/38] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:18 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1285 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:18.544340 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-335fa470-54e9-4417-b760-444f0c0973c0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:18.556306 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-335fa470-54e9-4417-b760-444f0c0973c0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1222 microversion: 2.1 time: 0.149890 Jun 23 10:50:18.557216 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 18/39] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:18 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:19.227582 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:19.228816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:19.244394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:19.245802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:19.248938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:19.249929 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:19.329430 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:19.339810 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:19.341877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:19.344065 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-266cf470-fdb5-4e99-8bdd-73ca02dc6ffc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1276 microversion: 2.20 time: 0.120569 Jun 23 10:50:19.350447 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 22/40] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:19 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:19.413283 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1008084b-b45b-4f31-9955-4e42794600c0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:19.414112 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1008084b-b45b-4f31-9955-4e42794600c0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:19.420842 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1008084b-b45b-4f31-9955-4e42794600c0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:19.421370 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1008084b-b45b-4f31-9955-4e42794600c0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:19.422354 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1008084b-b45b-4f31-9955-4e42794600c0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:19.422944 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1008084b-b45b-4f31-9955-4e42794600c0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:19.483776 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4caeb940-1cc2-44fc-aa15-f92e5e533be2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:19.484395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4caeb940-1cc2-44fc-aa15-f92e5e533be2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:19.502649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1008084b-b45b-4f31-9955-4e42794600c0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:19.513916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1008084b-b45b-4f31-9955-4e42794600c0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1245 microversion: 2.1 time: 0.104346 Jun 23 10:50:19.514257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4caeb940-1cc2-44fc-aa15-f92e5e533be2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:19.515274 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4caeb940-1cc2-44fc-aa15-f92e5e533be2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:19.516925 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 19/41] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:19 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:19.517258 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4caeb940-1cc2-44fc-aa15-f92e5e533be2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:19.517879 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4caeb940-1cc2-44fc-aa15-f92e5e533be2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:19.575110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d4ba72a3-3472-4aa8-ae9e-93624d57aa1a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:19.575746 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d4ba72a3-3472-4aa8-ae9e-93624d57aa1a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:19.585463 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d4ba72a3-3472-4aa8-ae9e-93624d57aa1a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:19.585980 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d4ba72a3-3472-4aa8-ae9e-93624d57aa1a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:19.590221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d4ba72a3-3472-4aa8-ae9e-93624d57aa1a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:19.592468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d4ba72a3-3472-4aa8-ae9e-93624d57aa1a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:19.598202 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4caeb940-1cc2-44fc-aa15-f92e5e533be2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:19.606471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4caeb940-1cc2-44fc-aa15-f92e5e533be2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1273 microversion: 2.1 time: 0.126459 Jun 23 10:50:19.607047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 23/42] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:19 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:19.669694 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d4ba72a3-3472-4aa8-ae9e-93624d57aa1a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:19.678386 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d4ba72a3-3472-4aa8-ae9e-93624d57aa1a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1226 microversion: 2.1 time: 0.109049 Jun 23 10:50:19.680195 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 20/43] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:19 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:20.363346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:20.363955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:20.375130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:20.377026 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:20.383840 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:20.384559 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:20.485674 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:20.495039 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:20.504003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:20.507555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-94fe35b9-7747-41d5-8154-be189993a792 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1276 microversion: 2.20 time: 0.148879 Jun 23 10:50:20.513331 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 24/44] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:20 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:20.533511 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7c6b4ea4-9d32-4586-bedf-863d307e414f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:20.539127 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7c6b4ea4-9d32-4586-bedf-863d307e414f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:20.566189 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7c6b4ea4-9d32-4586-bedf-863d307e414f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:20.566658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7c6b4ea4-9d32-4586-bedf-863d307e414f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:20.567453 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7c6b4ea4-9d32-4586-bedf-863d307e414f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:20.567892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7c6b4ea4-9d32-4586-bedf-863d307e414f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:20.624388 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-39c1860f-eea0-4d56-8dde-8af1518b8ca5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:20.625530 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-39c1860f-eea0-4d56-8dde-8af1518b8ca5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:20.633555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-39c1860f-eea0-4d56-8dde-8af1518b8ca5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:20.634949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-39c1860f-eea0-4d56-8dde-8af1518b8ca5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:20.636070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-39c1860f-eea0-4d56-8dde-8af1518b8ca5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:20.637129 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-39c1860f-eea0-4d56-8dde-8af1518b8ca5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:20.662795 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7c6b4ea4-9d32-4586-bedf-863d307e414f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:20.683600 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7c6b4ea4-9d32-4586-bedf-863d307e414f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1245 microversion: 2.1 time: 0.151651 Jun 23 10:50:20.699857 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 21/45] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:20 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:20.725820 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3e1bf645-e75e-44ed-9ec8-bd4da81b1e38 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:20.730206 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3e1bf645-e75e-44ed-9ec8-bd4da81b1e38 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:20.745200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3e1bf645-e75e-44ed-9ec8-bd4da81b1e38 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:20.747306 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3e1bf645-e75e-44ed-9ec8-bd4da81b1e38 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:20.752556 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3e1bf645-e75e-44ed-9ec8-bd4da81b1e38 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:20.753542 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3e1bf645-e75e-44ed-9ec8-bd4da81b1e38 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:20.788584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-39c1860f-eea0-4d56-8dde-8af1518b8ca5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:20.804736 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-39c1860f-eea0-4d56-8dde-8af1518b8ca5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1273 microversion: 2.1 time: 0.184062 Jun 23 10:50:20.806894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 25/46] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:20 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:20.935816 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3e1bf645-e75e-44ed-9ec8-bd4da81b1e38 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:20.976391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3e1bf645-e75e-44ed-9ec8-bd4da81b1e38 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1226 microversion: 2.1 time: 0.260676 Jun 23 10:50:20.977096 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 22/47] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:20 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1226 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:21.531711 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:21.532986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:21.545951 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:21.546824 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:21.547854 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:21.549875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:21.705719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4a2b7051-617b-4b83-9001-5ffa807ad3b4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:21.707442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4a2b7051-617b-4b83-9001-5ffa807ad3b4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:21.719417 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a2b7051-617b-4b83-9001-5ffa807ad3b4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:21.723035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a2b7051-617b-4b83-9001-5ffa807ad3b4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:21.724313 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a2b7051-617b-4b83-9001-5ffa807ad3b4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:21.724908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a2b7051-617b-4b83-9001-5ffa807ad3b4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:21.751535 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:21.762328 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:21.771885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:21.784164 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7aff728d-7f72-409f-95d6-14f2f487da5c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1340 microversion: 2.20 time: 0.256760 Jun 23 10:50:21.790814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 26/48] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:21 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1340 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:21.824760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3fd7baa9-a0b5-4651-9dd2-e9db5206f377 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:21.826000 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3fd7baa9-a0b5-4651-9dd2-e9db5206f377 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:21.834398 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3fd7baa9-a0b5-4651-9dd2-e9db5206f377 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:21.846287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3fd7baa9-a0b5-4651-9dd2-e9db5206f377 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:21.847493 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3fd7baa9-a0b5-4651-9dd2-e9db5206f377 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:21.848020 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3fd7baa9-a0b5-4651-9dd2-e9db5206f377 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:21.884120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4a2b7051-617b-4b83-9001-5ffa807ad3b4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:21.896226 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4a2b7051-617b-4b83-9001-5ffa807ad3b4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.194882 Jun 23 10:50:21.911297 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 23/49] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:21 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:21.949789 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3fd7baa9-a0b5-4651-9dd2-e9db5206f377 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:21.959097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3fd7baa9-a0b5-4651-9dd2-e9db5206f377 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1273 microversion: 2.1 time: 0.138820 Jun 23 10:50:21.960076 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 27/50] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:21 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:21.997645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-33a4fe0d-0db3-401d-a6cb-387014b97815 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:21.998603 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-33a4fe0d-0db3-401d-a6cb-387014b97815 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:22.006892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-33a4fe0d-0db3-401d-a6cb-387014b97815 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:22.007937 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-33a4fe0d-0db3-401d-a6cb-387014b97815 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:22.009010 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-33a4fe0d-0db3-401d-a6cb-387014b97815 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:22.009622 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-33a4fe0d-0db3-401d-a6cb-387014b97815 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:22.081613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-33a4fe0d-0db3-401d-a6cb-387014b97815 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:22.091517 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-33a4fe0d-0db3-401d-a6cb-387014b97815 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.097718 Jun 23 10:50:22.093155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 24/51] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:21 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:22.808793 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:22.809406 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:22.816099 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:22.816592 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:22.817405 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:22.817842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:22.889685 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:22.897752 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:22.899467 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:22.900585 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e84b9d6b-dfdf-4485-97f7-580f29efbe29 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.095582 Jun 23 10:50:22.901136 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 28/52] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:22 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:22.916700 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-dd0182c9-d175-4a4b-987c-37de8bb68871 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:22.917309 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-dd0182c9-d175-4a4b-987c-37de8bb68871 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:22.924469 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dd0182c9-d175-4a4b-987c-37de8bb68871 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:22.924909 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dd0182c9-d175-4a4b-987c-37de8bb68871 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:22.925678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dd0182c9-d175-4a4b-987c-37de8bb68871 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:22.926362 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dd0182c9-d175-4a4b-987c-37de8bb68871 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:22.976872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-dfc19ae7-a09d-493f-a778-003b56d12982 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:22.977517 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-dfc19ae7-a09d-493f-a778-003b56d12982 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:22.984251 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dfc19ae7-a09d-493f-a778-003b56d12982 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:22.984711 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dfc19ae7-a09d-493f-a778-003b56d12982 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:22.985491 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dfc19ae7-a09d-493f-a778-003b56d12982 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:22.985933 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dfc19ae7-a09d-493f-a778-003b56d12982 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:22.989722 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dd0182c9-d175-4a4b-987c-37de8bb68871 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:22.997314 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-dd0182c9-d175-4a4b-987c-37de8bb68871 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.084764 Jun 23 10:50:22.997874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 25/53] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:22 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:23.109174 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cfbf3e1d-22ab-41f2-b514-f3fc4d00c1f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:23.109888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-cfbf3e1d-22ab-41f2-b514-f3fc4d00c1f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:23.116103 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cfbf3e1d-22ab-41f2-b514-f3fc4d00c1f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:23.116564 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cfbf3e1d-22ab-41f2-b514-f3fc4d00c1f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:23.117393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cfbf3e1d-22ab-41f2-b514-f3fc4d00c1f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:23.117830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cfbf3e1d-22ab-41f2-b514-f3fc4d00c1f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:23.137544 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-dfc19ae7-a09d-493f-a778-003b56d12982 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:23.145714 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-dfc19ae7-a09d-493f-a778-003b56d12982 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.172685 Jun 23 10:50:23.146383 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 29/54] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:22 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:23.179013 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cfbf3e1d-22ab-41f2-b514-f3fc4d00c1f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:23.186868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-cfbf3e1d-22ab-41f2-b514-f3fc4d00c1f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.081513 Jun 23 10:50:23.187435 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 26/55] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:23 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:23.919742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:23.920341 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:23.926751 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:23.927191 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:23.927937 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:23.928371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:23.991085 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:24.001269 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:24.003544 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:24.005073 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b5d824bb-1c7e-4f96-b421-69bc702b3cc9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.089207 Jun 23 10:50:24.006099 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 30/56] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:23 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:24.014022 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-670e6707-5fa9-4a45-8705-dd980d39e7cf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:24.014752 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-670e6707-5fa9-4a45-8705-dd980d39e7cf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:24.020874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-670e6707-5fa9-4a45-8705-dd980d39e7cf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:24.021326 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-670e6707-5fa9-4a45-8705-dd980d39e7cf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:24.022091 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-670e6707-5fa9-4a45-8705-dd980d39e7cf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:24.022557 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-670e6707-5fa9-4a45-8705-dd980d39e7cf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:24.087114 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-670e6707-5fa9-4a45-8705-dd980d39e7cf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:24.095987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-670e6707-5fa9-4a45-8705-dd980d39e7cf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.085693 Jun 23 10:50:24.096553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 27/57] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:24 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:24.162908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8e61580f-fdaa-4814-a675-585cc19b1dd3 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:24.163501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8e61580f-fdaa-4814-a675-585cc19b1dd3 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:24.169612 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8e61580f-fdaa-4814-a675-585cc19b1dd3 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:24.170057 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8e61580f-fdaa-4814-a675-585cc19b1dd3 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:24.172154 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8e61580f-fdaa-4814-a675-585cc19b1dd3 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:24.172535 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8e61580f-fdaa-4814-a675-585cc19b1dd3 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:24.204196 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1182eb6d-9dec-415d-9936-e37628400006 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:24.204926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1182eb6d-9dec-415d-9936-e37628400006 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:24.211038 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1182eb6d-9dec-415d-9936-e37628400006 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:24.211486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1182eb6d-9dec-415d-9936-e37628400006 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:24.212247 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1182eb6d-9dec-415d-9936-e37628400006 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:24.212675 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1182eb6d-9dec-415d-9936-e37628400006 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:24.281928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1182eb6d-9dec-415d-9936-e37628400006 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:24.289376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1182eb6d-9dec-415d-9936-e37628400006 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.089449 Jun 23 10:50:24.289942 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 28/58] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:24 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:24.323731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8e61580f-fdaa-4814-a675-585cc19b1dd3 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:24.331781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8e61580f-fdaa-4814-a675-585cc19b1dd3 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.172628 Jun 23 10:50:24.332333 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 31/59] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:24 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:25.024068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:25.024670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:25.030782 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:25.031226 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:25.031976 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:25.032406 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:25.095228 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:25.108535 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:25.110042 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:25.111331 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-87a0b7b7-e123-4952-a64d-26e9bbfed054 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.090967 Jun 23 10:50:25.117432 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 29/60] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:25 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:25.119939 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6162551f-46d4-467e-a974-b8f4351bface tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:25.121063 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6162551f-46d4-467e-a974-b8f4351bface tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:25.128262 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6162551f-46d4-467e-a974-b8f4351bface tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:25.128776 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6162551f-46d4-467e-a974-b8f4351bface tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:25.129649 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6162551f-46d4-467e-a974-b8f4351bface tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:25.130219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6162551f-46d4-467e-a974-b8f4351bface tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:25.192402 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6162551f-46d4-467e-a974-b8f4351bface tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:25.199927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6162551f-46d4-467e-a974-b8f4351bface tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.091426 Jun 23 10:50:25.200485 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 32/61] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:25 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:25.307155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-241b03cd-4521-4e51-8119-3c9317110f99 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:25.307764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-241b03cd-4521-4e51-8119-3c9317110f99 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:25.314454 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-241b03cd-4521-4e51-8119-3c9317110f99 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:25.314898 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-241b03cd-4521-4e51-8119-3c9317110f99 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:25.315795 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-241b03cd-4521-4e51-8119-3c9317110f99 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:25.316237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-241b03cd-4521-4e51-8119-3c9317110f99 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:25.349191 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e15b7147-1023-48f9-b3e4-320ba7a02a17 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:25.349815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e15b7147-1023-48f9-b3e4-320ba7a02a17 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:25.356058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e15b7147-1023-48f9-b3e4-320ba7a02a17 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:25.356634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e15b7147-1023-48f9-b3e4-320ba7a02a17 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:25.357536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e15b7147-1023-48f9-b3e4-320ba7a02a17 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:25.358033 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e15b7147-1023-48f9-b3e4-320ba7a02a17 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:25.379355 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-241b03cd-4521-4e51-8119-3c9317110f99 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:25.388310 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-241b03cd-4521-4e51-8119-3c9317110f99 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.084899 Jun 23 10:50:25.389138 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 30/62] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:25 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:25.505960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e15b7147-1023-48f9-b3e4-320ba7a02a17 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:25.513669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e15b7147-1023-48f9-b3e4-320ba7a02a17 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.168382 Jun 23 10:50:25.514239 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 33/63] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:25 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:26.130595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:26.131160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:26.137434 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:26.137875 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:26.138729 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:26.140294 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:26.216510 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:26.217394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-89a9f401-2503-497a-87b7-58ed14584bd9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:26.218259 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-89a9f401-2503-497a-87b7-58ed14584bd9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:26.224496 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-89a9f401-2503-497a-87b7-58ed14584bd9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:26.224980 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-89a9f401-2503-497a-87b7-58ed14584bd9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:26.225786 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-89a9f401-2503-497a-87b7-58ed14584bd9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:26.226225 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-89a9f401-2503-497a-87b7-58ed14584bd9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:26.227165 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:26.228791 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:26.229956 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0d605215-d98b-4ab0-9cee-72bdcde78743 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.103450 Jun 23 10:50:26.230951 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 31/64] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:26 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:26.292762 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-89a9f401-2503-497a-87b7-58ed14584bd9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:26.300796 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-89a9f401-2503-497a-87b7-58ed14584bd9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.087278 Jun 23 10:50:26.301380 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 34/65] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:26 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:26.406908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-46636e0b-3a79-4fb2-b3a9-ca69804c2dbb tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:26.407698 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-46636e0b-3a79-4fb2-b3a9-ca69804c2dbb tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:26.414193 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-46636e0b-3a79-4fb2-b3a9-ca69804c2dbb tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:26.414742 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-46636e0b-3a79-4fb2-b3a9-ca69804c2dbb tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:26.415527 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-46636e0b-3a79-4fb2-b3a9-ca69804c2dbb tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:26.415951 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-46636e0b-3a79-4fb2-b3a9-ca69804c2dbb tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:26.508760 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-46636e0b-3a79-4fb2-b3a9-ca69804c2dbb tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:26.517720 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-46636e0b-3a79-4fb2-b3a9-ca69804c2dbb tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.115467 Jun 23 10:50:26.518874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 32/66] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:26 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:26.531815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4b3e0935-6325-4b82-a158-28645eb53460 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:26.532421 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4b3e0935-6325-4b82-a158-28645eb53460 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:26.550752 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4b3e0935-6325-4b82-a158-28645eb53460 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:26.551264 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4b3e0935-6325-4b82-a158-28645eb53460 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:26.551979 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4b3e0935-6325-4b82-a158-28645eb53460 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:26.552442 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4b3e0935-6325-4b82-a158-28645eb53460 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:26.726978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4b3e0935-6325-4b82-a158-28645eb53460 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:26.735143 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4b3e0935-6325-4b82-a158-28645eb53460 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.207628 Jun 23 10:50:26.735872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 35/67] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:26 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:27.251121 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:27.251690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:27.258182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:27.258659 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:27.259517 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:27.260027 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:27.318041 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-afeef652-f8ad-4f2a-aa6d-a7c375244bd0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:27.318695 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-afeef652-f8ad-4f2a-aa6d-a7c375244bd0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:27.325238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-afeef652-f8ad-4f2a-aa6d-a7c375244bd0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:27.325339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-afeef652-f8ad-4f2a-aa6d-a7c375244bd0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:27.326061 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-afeef652-f8ad-4f2a-aa6d-a7c375244bd0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:27.326521 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-afeef652-f8ad-4f2a-aa6d-a7c375244bd0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:27.327812 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:27.331689 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:27.338128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:27.340045 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:27.341970 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1ab5726b-42f9-423a-af14-c7642793bb10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.094775 Jun 23 10:50:27.343846 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 33/68] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:27 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:27.354359 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:27.404173 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-afeef652-f8ad-4f2a-aa6d-a7c375244bd0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:27.412424 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-afeef652-f8ad-4f2a-aa6d-a7c375244bd0 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.098011 Jun 23 10:50:27.413060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 36/69] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:27 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:27.536312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d307f307-2d24-4fd8-aa52-7982bcfc8ffa tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:27.536961 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d307f307-2d24-4fd8-aa52-7982bcfc8ffa tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:27.544452 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d307f307-2d24-4fd8-aa52-7982bcfc8ffa tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:27.544997 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d307f307-2d24-4fd8-aa52-7982bcfc8ffa tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:27.546235 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d307f307-2d24-4fd8-aa52-7982bcfc8ffa tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:27.546961 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d307f307-2d24-4fd8-aa52-7982bcfc8ffa tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:27.617431 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d307f307-2d24-4fd8-aa52-7982bcfc8ffa tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:27.625291 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d307f307-2d24-4fd8-aa52-7982bcfc8ffa tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.094536 Jun 23 10:50:27.626116 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 34/70] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:27 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:27.752604 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4dd27e70-5c1f-4437-9cb2-d9c0b89f6b41 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:27.753211 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4dd27e70-5c1f-4437-9cb2-d9c0b89f6b41 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:27.766175 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4dd27e70-5c1f-4437-9cb2-d9c0b89f6b41 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:27.766668 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4dd27e70-5c1f-4437-9cb2-d9c0b89f6b41 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:27.767529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4dd27e70-5c1f-4437-9cb2-d9c0b89f6b41 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:27.768182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4dd27e70-5c1f-4437-9cb2-d9c0b89f6b41 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:27.945954 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4dd27e70-5c1f-4437-9cb2-d9c0b89f6b41 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:27.957435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4dd27e70-5c1f-4437-9cb2-d9c0b89f6b41 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.208411 Jun 23 10:50:27.957861 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 37/71] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:27 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:28.361797 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:28.363428 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:28.370010 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=4 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.373160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:28.373934 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:28.375073 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:28.375793 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:28.431680 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-226a6687-e3f6-488b-a73e-7e5bc4e6a6c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:28.433922 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-226a6687-e3f6-488b-a73e-7e5bc4e6a6c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:28.442149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=6 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.444414 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=22 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.454869 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-226a6687-e3f6-488b-a73e-7e5bc4e6a6c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:28.455715 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-226a6687-e3f6-488b-a73e-7e5bc4e6a6c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:28.457180 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-226a6687-e3f6-488b-a73e-7e5bc4e6a6c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:28.458246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-226a6687-e3f6-488b-a73e-7e5bc4e6a6c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:28.476751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:28.488580 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:28.491130 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:28.492901 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fc6af342-076e-47d8-ab92-fbcf43359af9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.135547 Jun 23 10:50:28.494756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 35/72] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:28 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:28.584026 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-226a6687-e3f6-488b-a73e-7e5bc4e6a6c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:28.599032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-226a6687-e3f6-488b-a73e-7e5bc4e6a6c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.171605 Jun 23 10:50:28.600188 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 38/73] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:28 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:28.644825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fe202a6f-58f9-4384-9b48-1356f9d7b343 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:28.646017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fe202a6f-58f9-4384-9b48-1356f9d7b343 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:28.660606 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=24 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.660988 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.669328 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe202a6f-58f9-4384-9b48-1356f9d7b343 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:28.670041 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe202a6f-58f9-4384-9b48-1356f9d7b343 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:28.671650 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe202a6f-58f9-4384-9b48-1356f9d7b343 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:28.672274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe202a6f-58f9-4384-9b48-1356f9d7b343 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:28.805996 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fe202a6f-58f9-4384-9b48-1356f9d7b343 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:28.815441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fe202a6f-58f9-4384-9b48-1356f9d7b343 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.176774 Jun 23 10:50:28.817412 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 36/74] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:28 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:28.975865 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d69b835b-15ea-41f0-b113-ec7e27fbdeaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:28.976474 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d69b835b-15ea-41f0-b113-ec7e27fbdeaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:28.981302 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.983374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d69b835b-15ea-41f0-b113-ec7e27fbdeaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:28.984054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d69b835b-15ea-41f0-b113-ec7e27fbdeaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:28.984886 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d69b835b-15ea-41f0-b113-ec7e27fbdeaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:28.985392 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d69b835b-15ea-41f0-b113-ec7e27fbdeaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:29.150238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d69b835b-15ea-41f0-b113-ec7e27fbdeaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:29.160220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d69b835b-15ea-41f0-b113-ec7e27fbdeaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.188288 Jun 23 10:50:29.160802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 39/75] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:28 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:29.512576 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:29.513277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:29.520743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:29.521691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:29.522635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:29.523212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:29.606757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:29.617137 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8c7e4d0e-d652-4f00-a4c6-fe069b5ddd4e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:29.618339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8c7e4d0e-d652-4f00-a4c6-fe069b5ddd4e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:29.626001 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c7e4d0e-d652-4f00-a4c6-fe069b5ddd4e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:29.626211 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:29.626986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c7e4d0e-d652-4f00-a4c6-fe069b5ddd4e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:29.627704 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:29.628279 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c7e4d0e-d652-4f00-a4c6-fe069b5ddd4e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:29.628819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-340c0be4-ac22-44a2-9eb4-e6dffc41d659 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.121256 Jun 23 10:50:29.629208 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c7e4d0e-d652-4f00-a4c6-fe069b5ddd4e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:29.639625 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 37/76] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:29 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:29.840627 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-513947e8-f91d-4723-8f27-b71f125f0a67 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:29.842079 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-513947e8-f91d-4723-8f27-b71f125f0a67 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:29.859123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-513947e8-f91d-4723-8f27-b71f125f0a67 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:29.862746 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-513947e8-f91d-4723-8f27-b71f125f0a67 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:29.866862 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-513947e8-f91d-4723-8f27-b71f125f0a67 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:29.867785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-513947e8-f91d-4723-8f27-b71f125f0a67 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:29.876584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8c7e4d0e-d652-4f00-a4c6-fe069b5ddd4e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:29.886106 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8c7e4d0e-d652-4f00-a4c6-fe069b5ddd4e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.272905 Jun 23 10:50:29.886715 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 40/77] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:29 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:29.958914 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-513947e8-f91d-4723-8f27-b71f125f0a67 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:29.981399 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-513947e8-f91d-4723-8f27-b71f125f0a67 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.144680 Jun 23 10:50:29.984445 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 38/78] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:29 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:30.178077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c0201b0c-9393-4c5c-b7b0-7c76351b2dff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:30.178714 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c0201b0c-9393-4c5c-b7b0-7c76351b2dff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:30.185507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c0201b0c-9393-4c5c-b7b0-7c76351b2dff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:30.186194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c0201b0c-9393-4c5c-b7b0-7c76351b2dff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:30.190552 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c0201b0c-9393-4c5c-b7b0-7c76351b2dff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:30.190552 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c0201b0c-9393-4c5c-b7b0-7c76351b2dff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:30.400423 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c0201b0c-9393-4c5c-b7b0-7c76351b2dff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:30.421388 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c0201b0c-9393-4c5c-b7b0-7c76351b2dff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.245979 Jun 23 10:50:30.435909 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 41/79] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:30 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:30.649257 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:30.649875 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:30.664241 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:30.664669 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:30.665464 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:30.665900 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:30.779710 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:30.794738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:30.796650 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:30.797832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f192926d-9879-4e9f-b9ff-337d9b685040 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.152414 Jun 23 10:50:30.798498 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 39/80] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:30 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:30.903418 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6466c634-613e-472e-b70e-961d6e3ccd12 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:30.904732 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6466c634-613e-472e-b70e-961d6e3ccd12 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:30.911565 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6466c634-613e-472e-b70e-961d6e3ccd12 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:30.912288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6466c634-613e-472e-b70e-961d6e3ccd12 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:30.913272 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6466c634-613e-472e-b70e-961d6e3ccd12 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:30.913891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6466c634-613e-472e-b70e-961d6e3ccd12 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:30.982668 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6466c634-613e-472e-b70e-961d6e3ccd12 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:30.992059 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6466c634-613e-472e-b70e-961d6e3ccd12 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.092387 Jun 23 10:50:31.010478 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 42/81] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:30 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:31.018460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-88dae57e-6bc7-4743-b20a-c942bad82bb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:31.019450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-88dae57e-6bc7-4743-b20a-c942bad82bb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:31.025806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-88dae57e-6bc7-4743-b20a-c942bad82bb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:31.026465 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-88dae57e-6bc7-4743-b20a-c942bad82bb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:31.027469 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-88dae57e-6bc7-4743-b20a-c942bad82bb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:31.028001 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-88dae57e-6bc7-4743-b20a-c942bad82bb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:31.100350 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-88dae57e-6bc7-4743-b20a-c942bad82bb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:31.112815 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-88dae57e-6bc7-4743-b20a-c942bad82bb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.100801 Jun 23 10:50:31.122486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 40/82] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:31 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:31.439453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b9e82dc1-cfaf-40b0-9b21-3a03baeb7884 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:31.440069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b9e82dc1-cfaf-40b0-9b21-3a03baeb7884 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:31.446199 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9e82dc1-cfaf-40b0-9b21-3a03baeb7884 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:31.446677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9e82dc1-cfaf-40b0-9b21-3a03baeb7884 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:31.447707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9e82dc1-cfaf-40b0-9b21-3a03baeb7884 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:31.448137 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9e82dc1-cfaf-40b0-9b21-3a03baeb7884 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:31.626541 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b9e82dc1-cfaf-40b0-9b21-3a03baeb7884 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:31.634854 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b9e82dc1-cfaf-40b0-9b21-3a03baeb7884 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.200159 Jun 23 10:50:31.635725 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 43/83] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:31 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:31.818293 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:31.820199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:31.830083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:31.830567 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:31.831344 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:31.831779 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:31.914796 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:31.924664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:31.926193 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:31.927416 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c02fee96-379d-425c-ab73-fd95bfd72cc8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.115907 Jun 23 10:50:31.927961 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 41/84] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:31 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:32.017390 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-998faf18-a8ba-4017-b1ae-68dfdc49802f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:32.019696 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-998faf18-a8ba-4017-b1ae-68dfdc49802f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:32.027623 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-998faf18-a8ba-4017-b1ae-68dfdc49802f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:32.028564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-998faf18-a8ba-4017-b1ae-68dfdc49802f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:32.029513 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-998faf18-a8ba-4017-b1ae-68dfdc49802f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:32.030298 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-998faf18-a8ba-4017-b1ae-68dfdc49802f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:32.117622 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-998faf18-a8ba-4017-b1ae-68dfdc49802f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:32.129695 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5eefc89e-ea93-4f75-977c-20be88f2f7cf tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:32.130650 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5eefc89e-ea93-4f75-977c-20be88f2f7cf tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:32.132559 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-998faf18-a8ba-4017-b1ae-68dfdc49802f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.118618 Jun 23 10:50:32.137586 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5eefc89e-ea93-4f75-977c-20be88f2f7cf tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:32.138455 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5eefc89e-ea93-4f75-977c-20be88f2f7cf tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:32.139670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5eefc89e-ea93-4f75-977c-20be88f2f7cf tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:32.140316 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5eefc89e-ea93-4f75-977c-20be88f2f7cf tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:32.143141 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 44/85] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:32 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:32.219223 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5eefc89e-ea93-4f75-977c-20be88f2f7cf tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:32.230497 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5eefc89e-ea93-4f75-977c-20be88f2f7cf tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.104256 Jun 23 10:50:32.231305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 42/86] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:32 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:32.653386 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-99da9887-4b43-4d35-808b-810a51f48fc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:32.655024 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-99da9887-4b43-4d35-808b-810a51f48fc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:32.662078 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-99da9887-4b43-4d35-808b-810a51f48fc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:32.662768 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-99da9887-4b43-4d35-808b-810a51f48fc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:32.663720 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-99da9887-4b43-4d35-808b-810a51f48fc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:32.664297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-99da9887-4b43-4d35-808b-810a51f48fc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:32.852945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-99da9887-4b43-4d35-808b-810a51f48fc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:32.861759 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-99da9887-4b43-4d35-808b-810a51f48fc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.212759 Jun 23 10:50:32.862812 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 45/87] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:32 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:32.945964 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:32.948011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:32.955954 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:32.956585 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:32.957502 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:32.958279 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:33.043195 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:33.052642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:33.054133 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:33.055280 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6c31ed58-9400-4f84-9bbd-1a34ffd7f1f3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.113453 Jun 23 10:50:33.055850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 43/88] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:32 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:33.149886 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-382d8a8f-2011-4938-9add-2c840fcaf965 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:33.150597 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-382d8a8f-2011-4938-9add-2c840fcaf965 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:33.157580 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-382d8a8f-2011-4938-9add-2c840fcaf965 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:33.158020 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-382d8a8f-2011-4938-9add-2c840fcaf965 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:33.158906 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-382d8a8f-2011-4938-9add-2c840fcaf965 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:33.159560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-382d8a8f-2011-4938-9add-2c840fcaf965 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:33.252779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-382d8a8f-2011-4938-9add-2c840fcaf965 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:33.256529 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f5011a28-7878-49e3-9478-35db7179d1e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:33.257433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f5011a28-7878-49e3-9478-35db7179d1e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:33.263026 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-382d8a8f-2011-4938-9add-2c840fcaf965 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.115630 Jun 23 10:50:33.269541 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f5011a28-7878-49e3-9478-35db7179d1e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:33.270234 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f5011a28-7878-49e3-9478-35db7179d1e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:33.271187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f5011a28-7878-49e3-9478-35db7179d1e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:33.271773 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f5011a28-7878-49e3-9478-35db7179d1e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:33.274879 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 46/89] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:33 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:33.351769 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f5011a28-7878-49e3-9478-35db7179d1e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:33.359683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f5011a28-7878-49e3-9478-35db7179d1e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.115736 Jun 23 10:50:33.360257 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 44/90] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:33 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:33.878598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-42f1970c-749d-46e5-8d0c-3e96e5d32ee5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:33.879218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-42f1970c-749d-46e5-8d0c-3e96e5d32ee5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:33.888266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42f1970c-749d-46e5-8d0c-3e96e5d32ee5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:33.888712 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42f1970c-749d-46e5-8d0c-3e96e5d32ee5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:33.889670 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42f1970c-749d-46e5-8d0c-3e96e5d32ee5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:33.890282 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42f1970c-749d-46e5-8d0c-3e96e5d32ee5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:34.054547 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-42f1970c-749d-46e5-8d0c-3e96e5d32ee5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:34.073051 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-42f1970c-749d-46e5-8d0c-3e96e5d32ee5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.198857 Jun 23 10:50:34.073814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 47/91] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:33 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:34.084443 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:34.085060 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:34.093349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:34.094061 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:34.094926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:34.095289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:34.158093 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:34.166189 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:34.167701 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:34.168781 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7a973222-d7a6-4308-999c-792ff4180ecc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.097509 Jun 23 10:50:34.171419 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 45/92] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:34 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:34.281351 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0f718d02-aee4-4d5c-b6ff-30d59def74c5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:34.281968 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-0f718d02-aee4-4d5c-b6ff-30d59def74c5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:34.288347 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0f718d02-aee4-4d5c-b6ff-30d59def74c5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:34.288799 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0f718d02-aee4-4d5c-b6ff-30d59def74c5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:34.289554 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0f718d02-aee4-4d5c-b6ff-30d59def74c5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:34.290056 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0f718d02-aee4-4d5c-b6ff-30d59def74c5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:34.356536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-0f718d02-aee4-4d5c-b6ff-30d59def74c5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:34.365081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0f718d02-aee4-4d5c-b6ff-30d59def74c5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.087971 Jun 23 10:50:34.365646 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 48/93] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:34 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:34.381341 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a25b2ddc-ebcb-44eb-9d66-38a8af031928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:34.382030 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a25b2ddc-ebcb-44eb-9d66-38a8af031928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:34.388045 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a25b2ddc-ebcb-44eb-9d66-38a8af031928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:34.388580 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a25b2ddc-ebcb-44eb-9d66-38a8af031928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:34.390204 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a25b2ddc-ebcb-44eb-9d66-38a8af031928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:34.390675 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a25b2ddc-ebcb-44eb-9d66-38a8af031928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:34.455788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a25b2ddc-ebcb-44eb-9d66-38a8af031928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:34.463839 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a25b2ddc-ebcb-44eb-9d66-38a8af031928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.086653 Jun 23 10:50:34.464656 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 46/94] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:34 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:35.096589 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-128489ff-2396-4a66-8fa5-d41bad986a7f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:35.097190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-128489ff-2396-4a66-8fa5-d41bad986a7f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:35.111268 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-128489ff-2396-4a66-8fa5-d41bad986a7f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:35.111723 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-128489ff-2396-4a66-8fa5-d41bad986a7f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:35.112500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-128489ff-2396-4a66-8fa5-d41bad986a7f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:35.112939 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-128489ff-2396-4a66-8fa5-d41bad986a7f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:35.188465 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:35.189575 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:35.196298 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:35.196738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:35.204597 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:35.205098 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:35.267346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-128489ff-2396-4a66-8fa5-d41bad986a7f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:35.284044 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-128489ff-2396-4a66-8fa5-d41bad986a7f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.191343 Jun 23 10:50:35.284829 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:35.285979 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 49/95] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:35 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:35.294037 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:35.295616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:35.296900 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-92356460-0e2a-4e3f-b5f5-ce52ca6ec367 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.114080 Jun 23 10:50:35.297433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 47/96] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:35 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:35.382510 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3bfda600-a1b2-4fff-98fb-96cfe5608e81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:35.383234 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3bfda600-a1b2-4fff-98fb-96cfe5608e81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:35.389171 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3bfda600-a1b2-4fff-98fb-96cfe5608e81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:35.390746 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3bfda600-a1b2-4fff-98fb-96cfe5608e81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:35.391598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3bfda600-a1b2-4fff-98fb-96cfe5608e81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:35.392097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3bfda600-a1b2-4fff-98fb-96cfe5608e81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:35.456994 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3bfda600-a1b2-4fff-98fb-96cfe5608e81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:35.464362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3bfda600-a1b2-4fff-98fb-96cfe5608e81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.085775 Jun 23 10:50:35.475685 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 50/97] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:35 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:35.480446 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f9e506c1-7b86-43f6-bea6-7557620bca01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:35.481391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f9e506c1-7b86-43f6-bea6-7557620bca01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:35.488849 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9e506c1-7b86-43f6-bea6-7557620bca01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:35.489382 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9e506c1-7b86-43f6-bea6-7557620bca01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:35.490228 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9e506c1-7b86-43f6-bea6-7557620bca01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:35.490765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9e506c1-7b86-43f6-bea6-7557620bca01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:35.563773 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f9e506c1-7b86-43f6-bea6-7557620bca01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:35.571132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f9e506c1-7b86-43f6-bea6-7557620bca01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.094618 Jun 23 10:50:35.571693 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 48/98] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:35 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:36.303951 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e73512f9-81c9-4b24-a5ed-abf6a872efff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:36.304584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e73512f9-81c9-4b24-a5ed-abf6a872efff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:36.310810 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e73512f9-81c9-4b24-a5ed-abf6a872efff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:36.311890 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e73512f9-81c9-4b24-a5ed-abf6a872efff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:36.312937 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e73512f9-81c9-4b24-a5ed-abf6a872efff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:36.313581 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e73512f9-81c9-4b24-a5ed-abf6a872efff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:36.315383 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:36.316515 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:36.325135 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:36.326064 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:36.327965 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:36.328678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:36.418257 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:36.428228 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:36.429814 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:36.431104 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d08fce24-4ee7-4119-94b7-9706c45ae7c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.120478 Jun 23 10:50:36.431832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 49/99] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:36 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:36.483859 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cc6a03d9-012b-4d82-9216-4b5850a0be63 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:36.484569 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-cc6a03d9-012b-4d82-9216-4b5850a0be63 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:36.490899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cc6a03d9-012b-4d82-9216-4b5850a0be63 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:36.491555 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cc6a03d9-012b-4d82-9216-4b5850a0be63 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:36.492579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cc6a03d9-012b-4d82-9216-4b5850a0be63 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:36.493026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cc6a03d9-012b-4d82-9216-4b5850a0be63 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:36.496147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e73512f9-81c9-4b24-a5ed-abf6a872efff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:36.506281 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e73512f9-81c9-4b24-a5ed-abf6a872efff tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.209103 Jun 23 10:50:36.507023 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 51/100] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:36 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:36.523067 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.569821 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cc6a03d9-012b-4d82-9216-4b5850a0be63 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:36.578014 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-cc6a03d9-012b-4d82-9216-4b5850a0be63 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.098550 Jun 23 10:50:36.578606 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 50/101] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:36 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:36.588198 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-bd15e91a-fe07-456c-9f27-309eb283094a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:36.588796 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-bd15e91a-fe07-456c-9f27-309eb283094a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:36.595791 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bd15e91a-fe07-456c-9f27-309eb283094a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:36.596242 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bd15e91a-fe07-456c-9f27-309eb283094a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:36.597029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bd15e91a-fe07-456c-9f27-309eb283094a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:36.597584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bd15e91a-fe07-456c-9f27-309eb283094a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:36.664401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-bd15e91a-fe07-456c-9f27-309eb283094a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:36.671749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-bd15e91a-fe07-456c-9f27-309eb283094a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.087629 Jun 23 10:50:36.672294 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 52/102] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:36 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:37.449336 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:37.450030 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:37.457026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:37.457536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:37.458373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:37.458867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:37.525742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2910d2d6-d822-438c-ab16-3f461faf70b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:37.526522 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2910d2d6-d822-438c-ab16-3f461faf70b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:37.534626 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:37.534811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2910d2d6-d822-438c-ab16-3f461faf70b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:37.535320 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2910d2d6-d822-438c-ab16-3f461faf70b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:37.536428 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2910d2d6-d822-438c-ab16-3f461faf70b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:37.537054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2910d2d6-d822-438c-ab16-3f461faf70b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:37.542112 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:37.546176 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:37.547691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:37.548980 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a465660a-fa4d-4f26-a16a-7155be210607 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.103922 Jun 23 10:50:37.549531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 51/103] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:37 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:37.594307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-050e889d-b141-47fd-8803-ed6605e91f70 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:37.595100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-050e889d-b141-47fd-8803-ed6605e91f70 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:37.601163 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-050e889d-b141-47fd-8803-ed6605e91f70 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:37.601708 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-050e889d-b141-47fd-8803-ed6605e91f70 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:37.602649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-050e889d-b141-47fd-8803-ed6605e91f70 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:37.603184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-050e889d-b141-47fd-8803-ed6605e91f70 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:37.692077 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-050e889d-b141-47fd-8803-ed6605e91f70 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:37.699686 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-050e889d-b141-47fd-8803-ed6605e91f70 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.109204 Jun 23 10:50:37.700247 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 52/104] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:37 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:37.713172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-62684090-0c7f-48de-ae47-bb3cc67ec040 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:37.713773 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-62684090-0c7f-48de-ae47-bb3cc67ec040 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:37.720029 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62684090-0c7f-48de-ae47-bb3cc67ec040 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:37.720471 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62684090-0c7f-48de-ae47-bb3cc67ec040 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:37.721236 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62684090-0c7f-48de-ae47-bb3cc67ec040 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:37.721670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62684090-0c7f-48de-ae47-bb3cc67ec040 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:37.747134 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2910d2d6-d822-438c-ab16-3f461faf70b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:37.755641 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2910d2d6-d822-438c-ab16-3f461faf70b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.235255 Jun 23 10:50:37.756436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 53/105] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:37 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:37.797268 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-62684090-0c7f-48de-ae47-bb3cc67ec040 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:37.804518 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-62684090-0c7f-48de-ae47-bb3cc67ec040 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.103339 Jun 23 10:50:37.805075 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 53/106] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:37 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:38.567008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:38.567613 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:38.574625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:38.575193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:38.575970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:38.576422 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:38.657565 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:38.665647 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:38.667179 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:38.668286 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a1c273a2-bfac-41b7-8224-32d19c29ff65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.105332 Jun 23 10:50:38.668844 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 54/107] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:38 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:38.716982 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-faf9bd65-5590-4940-a14d-67c1caf1f197 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:38.718954 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-faf9bd65-5590-4940-a14d-67c1caf1f197 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:38.725099 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-faf9bd65-5590-4940-a14d-67c1caf1f197 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:38.725542 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-faf9bd65-5590-4940-a14d-67c1caf1f197 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:38.726348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-faf9bd65-5590-4940-a14d-67c1caf1f197 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:38.726783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-faf9bd65-5590-4940-a14d-67c1caf1f197 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:38.773090 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e222374f-28c9-4f29-82ed-d861bba7ca5b tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:38.773703 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e222374f-28c9-4f29-82ed-d861bba7ca5b tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:38.780376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e222374f-28c9-4f29-82ed-d861bba7ca5b tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:38.782431 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e222374f-28c9-4f29-82ed-d861bba7ca5b tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:38.782431 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e222374f-28c9-4f29-82ed-d861bba7ca5b tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:38.782431 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e222374f-28c9-4f29-82ed-d861bba7ca5b tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:38.816854 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-faf9bd65-5590-4940-a14d-67c1caf1f197 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:38.824573 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-faf9bd65-5590-4940-a14d-67c1caf1f197 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1293 microversion: 2.1 time: 0.111449 Jun 23 10:50:38.825139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 54/108] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:38 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:38.830918 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3ccb309d-f095-41b7-bc29-a5cb0ab36dba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:38.831539 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3ccb309d-f095-41b7-bc29-a5cb0ab36dba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:38.837530 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3ccb309d-f095-41b7-bc29-a5cb0ab36dba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:38.837934 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3ccb309d-f095-41b7-bc29-a5cb0ab36dba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:38.838749 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3ccb309d-f095-41b7-bc29-a5cb0ab36dba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:38.839178 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3ccb309d-f095-41b7-bc29-a5cb0ab36dba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:38.939759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3ccb309d-f095-41b7-bc29-a5cb0ab36dba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:38.947950 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3ccb309d-f095-41b7-bc29-a5cb0ab36dba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1274 microversion: 2.1 time: 0.121432 Jun 23 10:50:38.948604 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 55/109] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:38 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:39.025170 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e222374f-28c9-4f29-82ed-d861bba7ca5b tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:39.043566 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e222374f-28c9-4f29-82ed-d861bba7ca5b tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.274123 Jun 23 10:50:39.044200 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 55/110] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:38 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:39.688525 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:39.689372 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:39.699957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:39.702573 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:39.703365 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:39.707118 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:39.853667 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-262f75a4-ea30-4c5d-99dd-c4111cba8dfa tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:39.856037 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-262f75a4-ea30-4c5d-99dd-c4111cba8dfa tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:39.877146 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-262f75a4-ea30-4c5d-99dd-c4111cba8dfa tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:39.878796 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-262f75a4-ea30-4c5d-99dd-c4111cba8dfa tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:39.882166 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-262f75a4-ea30-4c5d-99dd-c4111cba8dfa tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:39.883023 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-262f75a4-ea30-4c5d-99dd-c4111cba8dfa tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:40.375137 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:40.379675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-262f75a4-ea30-4c5d-99dd-c4111cba8dfa tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:40.385120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:40.390669 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:40.394055 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a5ad9efb-f9ae-4448-bc72-58d2738ff31d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1338 microversion: 2.20 time: 0.710470 Jun 23 10:50:40.400450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 56/111] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:39 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1338 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:40.411351 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-262f75a4-ea30-4c5d-99dd-c4111cba8dfa tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1311 microversion: 2.1 time: 0.573824 Jun 23 10:50:40.423492 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 56/112] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:39 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1311 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:40.430157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e62ed7d2-0008-426f-adf6-7b38f1750248 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:40.434495 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e62ed7d2-0008-426f-adf6-7b38f1750248 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:40.434718 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ccec0d52-ea65-42f6-8d32-9dec3609dcdf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:40.434718 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ccec0d52-ea65-42f6-8d32-9dec3609dcdf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:40.444982 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ccec0d52-ea65-42f6-8d32-9dec3609dcdf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:40.445592 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ccec0d52-ea65-42f6-8d32-9dec3609dcdf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:40.447521 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ccec0d52-ea65-42f6-8d32-9dec3609dcdf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:40.451323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ccec0d52-ea65-42f6-8d32-9dec3609dcdf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:40.454691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e62ed7d2-0008-426f-adf6-7b38f1750248 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:40.455429 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e62ed7d2-0008-426f-adf6-7b38f1750248 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:40.457280 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e62ed7d2-0008-426f-adf6-7b38f1750248 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:40.457736 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e62ed7d2-0008-426f-adf6-7b38f1750248 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:40.722789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e62ed7d2-0008-426f-adf6-7b38f1750248 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:40.739123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e62ed7d2-0008-426f-adf6-7b38f1750248 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1280 microversion: 2.1 time: 0.316618 Jun 23 10:50:40.739685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 57/113] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:40 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:40.944546 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ccec0d52-ea65-42f6-8d32-9dec3609dcdf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:40.955083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ccec0d52-ea65-42f6-8d32-9dec3609dcdf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.528779 Jun 23 10:50:40.955658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 57/114] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:40 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:41.419039 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:41.421120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:41.430237 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b5751d74-ee89-4c02-adb0-c5a524bffaa8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:41.430986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b5751d74-ee89-4c02-adb0-c5a524bffaa8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:41.437862 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5751d74-ee89-4c02-adb0-c5a524bffaa8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:41.441775 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:41.443807 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5751d74-ee89-4c02-adb0-c5a524bffaa8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:41.445020 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5751d74-ee89-4c02-adb0-c5a524bffaa8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:41.450045 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:41.450648 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5751d74-ee89-4c02-adb0-c5a524bffaa8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:41.451837 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:41.457005 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:41.659766 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b5751d74-ee89-4c02-adb0-c5a524bffaa8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:41.671900 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b5751d74-ee89-4c02-adb0-c5a524bffaa8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1299 microversion: 2.1 time: 0.244115 Jun 23 10:50:41.672409 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 58/115] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:41 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1299 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:41.756402 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-540f4156-fce4-4b77-975c-de1bd07f1720 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:41.757013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-540f4156-fce4-4b77-975c-de1bd07f1720 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:41.788772 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-540f4156-fce4-4b77-975c-de1bd07f1720 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:41.789100 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-540f4156-fce4-4b77-975c-de1bd07f1720 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:41.789890 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-540f4156-fce4-4b77-975c-de1bd07f1720 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:41.790365 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-540f4156-fce4-4b77-975c-de1bd07f1720 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:41.911995 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-540f4156-fce4-4b77-975c-de1bd07f1720 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:41.925140 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-540f4156-fce4-4b77-975c-de1bd07f1720 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1280 microversion: 2.1 time: 0.172407 Jun 23 10:50:41.926710 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:41.931682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 59/116] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:41 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:41.937124 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:41.939194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:41.940439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d10b7e45-a525-486f-b9f9-f2bb8fdc2d4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.525663 Jun 23 10:50:41.941435 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 58/117] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:41 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:41.972682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-de88c46f-f7bf-4696-94d3-514b55deb897 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:41.973216 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-de88c46f-f7bf-4696-94d3-514b55deb897 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:41.979573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-de88c46f-f7bf-4696-94d3-514b55deb897 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:41.980237 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-de88c46f-f7bf-4696-94d3-514b55deb897 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:41.980994 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-de88c46f-f7bf-4696-94d3-514b55deb897 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:41.981583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-de88c46f-f7bf-4696-94d3-514b55deb897 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:42.274176 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-de88c46f-f7bf-4696-94d3-514b55deb897 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:42.297331 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-de88c46f-f7bf-4696-94d3-514b55deb897 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.322708 Jun 23 10:50:42.298156 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 60/118] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:41 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:42.689355 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c3cc3ab0-1a04-4fd4-b961-0783abf5ac6d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:42.690161 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c3cc3ab0-1a04-4fd4-b961-0783abf5ac6d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:42.698188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c3cc3ab0-1a04-4fd4-b961-0783abf5ac6d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:42.698834 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c3cc3ab0-1a04-4fd4-b961-0783abf5ac6d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:42.699935 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c3cc3ab0-1a04-4fd4-b961-0783abf5ac6d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:42.700838 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c3cc3ab0-1a04-4fd4-b961-0783abf5ac6d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:42.781222 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c3cc3ab0-1a04-4fd4-b961-0783abf5ac6d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:42.794141 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c3cc3ab0-1a04-4fd4-b961-0783abf5ac6d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1299 microversion: 2.1 time: 0.109387 Jun 23 10:50:42.795695 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 59/119] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:42 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:42.808958 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-168c8b1d-ef45-4245-987b-b317b6aadfd3 req-c96cfb74-d69e-41e0-8980-a40452957bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "737a2c37-15f8-4f42-a879-af5af910fd30", "tag": "025ad83b-3dde-441a-ae8a-ae243337df1c"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:42.834452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-168c8b1d-ef45-4245-987b-b317b6aadfd3 req-c96cfb74-d69e-41e0-8980-a40452957bb5 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:42.838970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-168c8b1d-ef45-4245-987b-b317b6aadfd3 req-c96cfb74-d69e-41e0-8980-a40452957bb5 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:42.860731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-168c8b1d-ef45-4245-987b-b317b6aadfd3 req-c96cfb74-d69e-41e0-8980-a40452957bb5 service nova] Creating event network-changed:025ad83b-3dde-441a-ae8a-ae243337df1c for instance 737a2c37-15f8-4f42-a879-af5af910fd30 on hv-cinder-84614 Jun 23 10:50:42.861256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-168c8b1d-ef45-4245-987b-b317b6aadfd3 req-c96cfb74-d69e-41e0-8980-a40452957bb5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 10:50:42.862447 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c208211d-d0cf-4530-82ff-34153d068006 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:42.863291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c208211d-d0cf-4530-82ff-34153d068006 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:42.864110 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c208211d-d0cf-4530-82ff-34153d068006 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:42.864532 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c208211d-d0cf-4530-82ff-34153d068006 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:42.873503 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.compute.rpcapi [None req-c208211d-d0cf-4530-82ff-34153d068006 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 10:50:42.874390 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c208211d-d0cf-4530-82ff-34153d068006 None None] Releasing lock "compute-rpcapi-router" {{(pid=129461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 10:50:42.890397 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c208211d-d0cf-4530-82ff-34153d068006 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157434 Jun 23 10:50:42.891222 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 61/120] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:50:42.945342 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-915d1874-348c-4ec6-a432-7ebf7005f210 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:42.946081 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-915d1874-348c-4ec6-a432-7ebf7005f210 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:42.954347 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-915d1874-348c-4ec6-a432-7ebf7005f210 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:42.955529 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-915d1874-348c-4ec6-a432-7ebf7005f210 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:42.956542 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-915d1874-348c-4ec6-a432-7ebf7005f210 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:42.957263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-915d1874-348c-4ec6-a432-7ebf7005f210 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:42.961362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:42.962094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:42.984521 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:42.985134 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:42.985923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:42.986536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:43.205355 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-915d1874-348c-4ec6-a432-7ebf7005f210 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:43.222733 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:43.244230 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:43.245097 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-915d1874-348c-4ec6-a432-7ebf7005f210 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.303896 Jun 23 10:50:43.256860 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 60/121] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:42 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:43.257144 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:43.257144 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-119c0d71-d70f-4078-a726-b72a8e8e93b2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.294161 Jun 23 10:50:43.257144 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 62/122] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:42 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:43.314931 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-94a2cf33-a829-4ba8-8fd8-eddf13e676fb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:43.315541 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-94a2cf33-a829-4ba8-8fd8-eddf13e676fb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:43.322123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-94a2cf33-a829-4ba8-8fd8-eddf13e676fb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:43.323343 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-94a2cf33-a829-4ba8-8fd8-eddf13e676fb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:43.324554 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-94a2cf33-a829-4ba8-8fd8-eddf13e676fb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:43.325167 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-94a2cf33-a829-4ba8-8fd8-eddf13e676fb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:43.503715 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-2a27cfaf-e4f9-429c-8649-41b54b8d3498 req-044d934d-119d-4e19-814e-4836d2f86a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "737144bf-12fa-4bec-9855-65112e48ed69", "tag": "595093b4-73b8-48ea-94e4-d0a5a594b1ff"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:43.528827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-2a27cfaf-e4f9-429c-8649-41b54b8d3498 req-044d934d-119d-4e19-814e-4836d2f86a6e service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:43.531870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-2a27cfaf-e4f9-429c-8649-41b54b8d3498 req-044d934d-119d-4e19-814e-4836d2f86a6e service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:43.580570 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-2a27cfaf-e4f9-429c-8649-41b54b8d3498 req-044d934d-119d-4e19-814e-4836d2f86a6e service nova] Creating event network-changed:595093b4-73b8-48ea-94e4-d0a5a594b1ff for instance 737144bf-12fa-4bec-9855-65112e48ed69 on hv-cinder-84614 Jun 23 10:50:43.586970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-2a27cfaf-e4f9-429c-8649-41b54b8d3498 req-044d934d-119d-4e19-814e-4836d2f86a6e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225876 Jun 23 10:50:43.588447 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 63/123] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:50:43.652138 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-94a2cf33-a829-4ba8-8fd8-eddf13e676fb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:43.662850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-94a2cf33-a829-4ba8-8fd8-eddf13e676fb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.351826 Jun 23 10:50:43.674185 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 61/124] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:43 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:43.814366 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ac6eff94-badc-44a9-a382-d2cd0aa3b421 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:43.815085 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ac6eff94-badc-44a9-a382-d2cd0aa3b421 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:43.830401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ac6eff94-badc-44a9-a382-d2cd0aa3b421 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:43.830863 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ac6eff94-badc-44a9-a382-d2cd0aa3b421 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:43.832347 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ac6eff94-badc-44a9-a382-d2cd0aa3b421 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:43.832784 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ac6eff94-badc-44a9-a382-d2cd0aa3b421 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:44.057437 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ac6eff94-badc-44a9-a382-d2cd0aa3b421 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:44.065062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ac6eff94-badc-44a9-a382-d2cd0aa3b421 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.256644 Jun 23 10:50:44.065578 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 64/125] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:43 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:44.265211 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f1393b5f-2265-42e5-a736-e84a05339947 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:44.265828 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f1393b5f-2265-42e5-a736-e84a05339947 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:44.272215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f1393b5f-2265-42e5-a736-e84a05339947 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:44.272657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f1393b5f-2265-42e5-a736-e84a05339947 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:44.273274 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:44.273876 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:44.274514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f1393b5f-2265-42e5-a736-e84a05339947 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:44.274990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f1393b5f-2265-42e5-a736-e84a05339947 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:44.280536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:44.281421 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:44.282412 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:44.283051 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:44.466423 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f1393b5f-2265-42e5-a736-e84a05339947 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:44.470378 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:44.474837 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f1393b5f-2265-42e5-a736-e84a05339947 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.214113 Jun 23 10:50:44.475530 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 62/126] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:44 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:44.478112 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:44.479786 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:44.480863 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e8d2ed4f-5690-464e-89f2-a67020371a22 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.211334 Jun 23 10:50:44.481402 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 65/127] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:44 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:44.679339 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6d1965d4-6721-42ab-9ae8-42d7422a3bc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:44.679945 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6d1965d4-6721-42ab-9ae8-42d7422a3bc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:44.687652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d1965d4-6721-42ab-9ae8-42d7422a3bc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:44.688106 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d1965d4-6721-42ab-9ae8-42d7422a3bc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:44.688900 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d1965d4-6721-42ab-9ae8-42d7422a3bc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:44.689336 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d1965d4-6721-42ab-9ae8-42d7422a3bc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:44.832849 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6d1965d4-6721-42ab-9ae8-42d7422a3bc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:44.840317 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6d1965d4-6721-42ab-9ae8-42d7422a3bc4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.164840 Jun 23 10:50:44.840902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 63/128] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:44 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:45.082083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-94abef62-37b1-44c9-bcfb-25fd0cf69edc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:45.082647 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-94abef62-37b1-44c9-bcfb-25fd0cf69edc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:45.088584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-94abef62-37b1-44c9-bcfb-25fd0cf69edc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.089436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-94abef62-37b1-44c9-bcfb-25fd0cf69edc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.090462 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-94abef62-37b1-44c9-bcfb-25fd0cf69edc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.090890 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-94abef62-37b1-44c9-bcfb-25fd0cf69edc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.222572 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-94abef62-37b1-44c9-bcfb-25fd0cf69edc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:45.230599 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-94abef62-37b1-44c9-bcfb-25fd0cf69edc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.152605 Jun 23 10:50:45.231163 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 66/129] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:45 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:45.492046 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-06db1681-5f52-4d80-ab65-4fd2c8bd413f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:45.492643 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-06db1681-5f52-4d80-ab65-4fd2c8bd413f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:45.500058 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06db1681-5f52-4d80-ab65-4fd2c8bd413f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.500351 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:45.500697 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06db1681-5f52-4d80-ab65-4fd2c8bd413f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.501153 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:45.501449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06db1681-5f52-4d80-ab65-4fd2c8bd413f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.501872 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06db1681-5f52-4d80-ab65-4fd2c8bd413f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.508427 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.508989 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.509898 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.510456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.698685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-06db1681-5f52-4d80-ab65-4fd2c8bd413f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:45.706474 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-06db1681-5f52-4d80-ab65-4fd2c8bd413f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.218146 Jun 23 10:50:45.707037 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 64/130] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:45 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:45.711556 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-cb6a4e09-3811-433a-965e-1469a2e84f7b req-deb8d123-7f62-4e52-939f-d8ee3ad1e948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdecdfe5-d298-4823-a396-cf390e769f92", "tag": "62749cc8-f2ed-4f3d-857d-f18de666a6ca"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:45.716077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:45.722486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-cb6a4e09-3811-433a-965e-1469a2e84f7b req-deb8d123-7f62-4e52-939f-d8ee3ad1e948 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.722930 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-cb6a4e09-3811-433a-965e-1469a2e84f7b req-deb8d123-7f62-4e52-939f-d8ee3ad1e948 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.724811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:45.726423 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:45.727731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4a10def7-425b-46a7-a020-6cb4e0689198 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.233056 Jun 23 10:50:45.728353 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 67/131] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:45 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:45.742677 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-cb6a4e09-3811-433a-965e-1469a2e84f7b req-deb8d123-7f62-4e52-939f-d8ee3ad1e948 service nova] Creating event network-changed:62749cc8-f2ed-4f3d-857d-f18de666a6ca for instance bdecdfe5-d298-4823-a396-cf390e769f92 on hv-cinder-84614 Jun 23 10:50:45.743208 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-cb6a4e09-3811-433a-965e-1469a2e84f7b req-deb8d123-7f62-4e52-939f-d8ee3ad1e948 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129460) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 10:50:45.744285 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55b79e1f-f0ae-4293-b0b5-e19a14bc8bd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.744722 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55b79e1f-f0ae-4293-b0b5-e19a14bc8bd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.745522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55b79e1f-f0ae-4293-b0b5-e19a14bc8bd1 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.745955 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55b79e1f-f0ae-4293-b0b5-e19a14bc8bd1 None None] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.754592 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.compute.rpcapi [None req-55b79e1f-f0ae-4293-b0b5-e19a14bc8bd1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 10:50:45.755437 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55b79e1f-f0ae-4293-b0b5-e19a14bc8bd1 None None] Releasing lock "compute-rpcapi-router" {{(pid=129460) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 10:50:45.770587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-55b79e1f-f0ae-4293-b0b5-e19a14bc8bd1 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062207 Jun 23 10:50:45.771169 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 65/132] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:50:45.858297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fb124f36-2355-44f9-b09d-49a5e1a9697d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:45.858880 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fb124f36-2355-44f9-b09d-49a5e1a9697d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:45.864792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fb124f36-2355-44f9-b09d-49a5e1a9697d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.865233 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fb124f36-2355-44f9-b09d-49a5e1a9697d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.865975 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fb124f36-2355-44f9-b09d-49a5e1a9697d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:45.866434 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fb124f36-2355-44f9-b09d-49a5e1a9697d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:45.992414 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-fb124f36-2355-44f9-b09d-49a5e1a9697d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:46.000217 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fb124f36-2355-44f9-b09d-49a5e1a9697d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.146367 Jun 23 10:50:46.000780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 68/133] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:45 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:46.255968 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1ebf5a7e-8a55-4473-9328-f9d9258aeafd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:46.256672 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1ebf5a7e-8a55-4473-9328-f9d9258aeafd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:46.263569 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a7e-8a55-4473-9328-f9d9258aeafd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:46.264113 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a7e-8a55-4473-9328-f9d9258aeafd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:46.265216 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a7e-8a55-4473-9328-f9d9258aeafd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:46.265654 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a7e-8a55-4473-9328-f9d9258aeafd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:46.724068 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7b1628ba-15b9-40fc-85a6-ffb10a92714f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:46.724987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7b1628ba-15b9-40fc-85a6-ffb10a92714f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:46.731584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7b1628ba-15b9-40fc-85a6-ffb10a92714f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:46.732558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7b1628ba-15b9-40fc-85a6-ffb10a92714f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:46.734418 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7b1628ba-15b9-40fc-85a6-ffb10a92714f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:46.735110 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7b1628ba-15b9-40fc-85a6-ffb10a92714f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:46.763235 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1ebf5a7e-8a55-4473-9328-f9d9258aeafd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:46.775836 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1ebf5a7e-8a55-4473-9328-f9d9258aeafd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.529241 Jun 23 10:50:46.777378 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 66/134] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:46 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:46.793108 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:46.794182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:46.802358 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:46.802950 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:46.803989 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:46.804511 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:46.825850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:47.129864 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7b1628ba-15b9-40fc-85a6-ffb10a92714f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:47.144700 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:47.155304 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:47.158026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:47.159582 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-18a8f741-f968-4bfb-9920-41dc827294e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.380881 Jun 23 10:50:47.160036 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7b1628ba-15b9-40fc-85a6-ffb10a92714f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.439638 Jun 23 10:50:47.160600 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 67/135] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:46 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:47.175875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 69/136] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:46 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:47.179150 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8eea6eb8-45eb-421b-a34e-f293cc26766c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:47.179841 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8eea6eb8-45eb-421b-a34e-f293cc26766c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:47.190788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8eea6eb8-45eb-421b-a34e-f293cc26766c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:47.191809 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8eea6eb8-45eb-421b-a34e-f293cc26766c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:47.192816 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8eea6eb8-45eb-421b-a34e-f293cc26766c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:47.199870 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8eea6eb8-45eb-421b-a34e-f293cc26766c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:47.501840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8eea6eb8-45eb-421b-a34e-f293cc26766c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:47.528691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8eea6eb8-45eb-421b-a34e-f293cc26766c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.364126 Jun 23 10:50:47.530757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 68/137] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:47 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:47.794523 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-26d162a7-4103-43eb-b293-1d079682ea81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:47.797111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-26d162a7-4103-43eb-b293-1d079682ea81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:47.807846 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-26d162a7-4103-43eb-b293-1d079682ea81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:47.808625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-26d162a7-4103-43eb-b293-1d079682ea81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:47.810102 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-26d162a7-4103-43eb-b293-1d079682ea81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:47.810754 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-26d162a7-4103-43eb-b293-1d079682ea81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:48.007107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-26d162a7-4103-43eb-b293-1d079682ea81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:48.010571 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:48.015838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-26d162a7-4103-43eb-b293-1d079682ea81 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.226470 Jun 23 10:50:48.016605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 70/138] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:47 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:48.203133 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:48.203887 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:48.210976 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e7f2dc49-ce24-4992-8dad-c036e29c82e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:48.211601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e7f2dc49-ce24-4992-8dad-c036e29c82e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:48.219947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e7f2dc49-ce24-4992-8dad-c036e29c82e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:48.220398 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e7f2dc49-ce24-4992-8dad-c036e29c82e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:48.226003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:48.226492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:48.227266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:48.227790 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:48.231301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e7f2dc49-ce24-4992-8dad-c036e29c82e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:48.231945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e7f2dc49-ce24-4992-8dad-c036e29c82e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:48.523374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e7f2dc49-ce24-4992-8dad-c036e29c82e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:48.527958 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:48.534155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e7f2dc49-ce24-4992-8dad-c036e29c82e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.327391 Jun 23 10:50:48.535476 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 71/139] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:48 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:48.548382 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:48.550697 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:48.552156 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-79c72b22-a979-4459-9fa1-de5b3a400ac8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.352957 Jun 23 10:50:48.559223 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-048728ca-1009-477d-a925-5da0804bfe9f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:48.559223 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-048728ca-1009-477d-a925-5da0804bfe9f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:48.560009 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 69/140] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:48 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:48.592835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-048728ca-1009-477d-a925-5da0804bfe9f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:48.593450 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-048728ca-1009-477d-a925-5da0804bfe9f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:48.594402 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-048728ca-1009-477d-a925-5da0804bfe9f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:48.594853 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-048728ca-1009-477d-a925-5da0804bfe9f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:48.672320 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-4da6eef9-10b2-4994-bcc8-443faa3c1b49 req-e4d97c6c-1bb5-4535-8591-7f2548e10af3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "288db671-2fdd-4a32-bc84-b325f6606ea1", "tag": "3f493c22-ce91-4339-80e5-f1905a1b0046"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:48.684177 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-4da6eef9-10b2-4994-bcc8-443faa3c1b49 req-e4d97c6c-1bb5-4535-8591-7f2548e10af3 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:48.685642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-4da6eef9-10b2-4994-bcc8-443faa3c1b49 req-e4d97c6c-1bb5-4535-8591-7f2548e10af3 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:48.720323 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-4da6eef9-10b2-4994-bcc8-443faa3c1b49 req-e4d97c6c-1bb5-4535-8591-7f2548e10af3 service nova] Creating event network-changed:3f493c22-ce91-4339-80e5-f1905a1b0046 for instance 288db671-2fdd-4a32-bc84-b325f6606ea1 on hv-cinder-84614 Jun 23 10:50:48.729106 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-4da6eef9-10b2-4994-bcc8-443faa3c1b49 req-e4d97c6c-1bb5-4535-8591-7f2548e10af3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065437 Jun 23 10:50:48.729962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 70/141] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:50:48.851004 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-048728ca-1009-477d-a925-5da0804bfe9f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:48.860881 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-048728ca-1009-477d-a925-5da0804bfe9f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.318807 Jun 23 10:50:48.862179 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 72/142] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:48 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:49.041764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8439ac5e-1856-482a-8e5c-339448760947 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:49.042763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8439ac5e-1856-482a-8e5c-339448760947 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:49.051469 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8439ac5e-1856-482a-8e5c-339448760947 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:49.052307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8439ac5e-1856-482a-8e5c-339448760947 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:49.053171 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8439ac5e-1856-482a-8e5c-339448760947 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:49.053715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8439ac5e-1856-482a-8e5c-339448760947 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:49.214516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8439ac5e-1856-482a-8e5c-339448760947 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:49.224051 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8439ac5e-1856-482a-8e5c-339448760947 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.187364 Jun 23 10:50:49.224632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 71/143] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:49 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:49.551538 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b3e1271f-6ef4-4a2b-b89a-681f2f4dd50c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:49.552140 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b3e1271f-6ef4-4a2b-b89a-681f2f4dd50c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:49.558000 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b3e1271f-6ef4-4a2b-b89a-681f2f4dd50c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:49.558403 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b3e1271f-6ef4-4a2b-b89a-681f2f4dd50c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:49.559159 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b3e1271f-6ef4-4a2b-b89a-681f2f4dd50c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:49.559583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b3e1271f-6ef4-4a2b-b89a-681f2f4dd50c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:49.582456 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:49.583348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:49.591788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:49.593144 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:49.594074 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:49.594668 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:49.991386 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b3e1271f-6ef4-4a2b-b89a-681f2f4dd50c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:50.002413 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b3e1271f-6ef4-4a2b-b89a-681f2f4dd50c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.452619 Jun 23 10:50:50.003220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 73/144] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:49 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:50.019080 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4fec51cb-acbd-4ee3-8e43-ccf46b834448 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:50.019870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4fec51cb-acbd-4ee3-8e43-ccf46b834448 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:50.031800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4fec51cb-acbd-4ee3-8e43-ccf46b834448 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:50.032477 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4fec51cb-acbd-4ee3-8e43-ccf46b834448 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:50.033266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4fec51cb-acbd-4ee3-8e43-ccf46b834448 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:50.033692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4fec51cb-acbd-4ee3-8e43-ccf46b834448 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:50.034391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:50.053735 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:50.057160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:50.058788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-883588f0-0155-4f51-8a6e-4dc041b761f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.481164 Jun 23 10:50:50.060119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 72/145] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:49 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:50.216097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4fec51cb-acbd-4ee3-8e43-ccf46b834448 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:50.226605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4fec51cb-acbd-4ee3-8e43-ccf46b834448 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.212855 Jun 23 10:50:50.227623 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 74/146] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:50 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:50.242935 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-563e68d5-4171-443e-9c1c-26b3170d6bbf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:50.243550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-563e68d5-4171-443e-9c1c-26b3170d6bbf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:50.250434 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-563e68d5-4171-443e-9c1c-26b3170d6bbf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:50.250882 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-563e68d5-4171-443e-9c1c-26b3170d6bbf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:50.251654 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-563e68d5-4171-443e-9c1c-26b3170d6bbf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:50.252084 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-563e68d5-4171-443e-9c1c-26b3170d6bbf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:50.434794 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-563e68d5-4171-443e-9c1c-26b3170d6bbf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:50.442550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-563e68d5-4171-443e-9c1c-26b3170d6bbf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.205370 Jun 23 10:50:50.443117 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 73/147] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:50 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:50.761534 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-552fbe20-fbda-4b6c-bfcd-e41602df32e8 req-d7c3baa2-5bb2-41f2-82be-051fbed2a06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b14d1ef1-2756-4058-a3e8-52c83a121833", "tag": "9c57cf5e-0cd4-4e3a-9734-57918143c3e0"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:50:50.771473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-552fbe20-fbda-4b6c-bfcd-e41602df32e8 req-d7c3baa2-5bb2-41f2-82be-051fbed2a06a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:50.771877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-552fbe20-fbda-4b6c-bfcd-e41602df32e8 req-d7c3baa2-5bb2-41f2-82be-051fbed2a06a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:50.783113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-552fbe20-fbda-4b6c-bfcd-e41602df32e8 req-d7c3baa2-5bb2-41f2-82be-051fbed2a06a service nova] Creating event network-changed:9c57cf5e-0cd4-4e3a-9734-57918143c3e0 for instance b14d1ef1-2756-4058-a3e8-52c83a121833 on hv-cinder-84614 Jun 23 10:50:50.788139 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-552fbe20-fbda-4b6c-bfcd-e41602df32e8 req-d7c3baa2-5bb2-41f2-82be-051fbed2a06a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030870 Jun 23 10:50:50.788922 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 75/148] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:50:51.019630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3eb93ed6-7ba4-4075-ac13-8ec651a3f43c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:51.020258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3eb93ed6-7ba4-4075-ac13-8ec651a3f43c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:51.026939 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3eb93ed6-7ba4-4075-ac13-8ec651a3f43c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:51.027380 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3eb93ed6-7ba4-4075-ac13-8ec651a3f43c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:51.029035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3eb93ed6-7ba4-4075-ac13-8ec651a3f43c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:51.029035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3eb93ed6-7ba4-4075-ac13-8ec651a3f43c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:51.078502 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:51.079355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:51.086607 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:51.087052 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:51.088527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:51.088992 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:51.213809 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3eb93ed6-7ba4-4075-ac13-8ec651a3f43c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:51.221741 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3eb93ed6-7ba4-4075-ac13-8ec651a3f43c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.205907 Jun 23 10:50:51.231891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 74/149] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:51 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:51.244609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9079d045-6726-4bcf-a82b-a8f7efb2de7c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:51.245333 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9079d045-6726-4bcf-a82b-a8f7efb2de7c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:51.253371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:51.256812 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9079d045-6726-4bcf-a82b-a8f7efb2de7c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:51.257325 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9079d045-6726-4bcf-a82b-a8f7efb2de7c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:51.258398 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9079d045-6726-4bcf-a82b-a8f7efb2de7c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:51.258838 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9079d045-6726-4bcf-a82b-a8f7efb2de7c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:51.262233 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:51.263967 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:51.265895 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-09e09d0b-90cc-41eb-a861-a653296a476e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.192265 Jun 23 10:50:51.266456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 76/150] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:51 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:51.414085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9079d045-6726-4bcf-a82b-a8f7efb2de7c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:51.423451 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9079d045-6726-4bcf-a82b-a8f7efb2de7c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.183429 Jun 23 10:50:51.426684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 75/151] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:51 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:51.459322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7bd53307-ce7b-40cf-b728-978bf85b5e62 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:51.459927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7bd53307-ce7b-40cf-b728-978bf85b5e62 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:51.465786 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7bd53307-ce7b-40cf-b728-978bf85b5e62 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:51.466510 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7bd53307-ce7b-40cf-b728-978bf85b5e62 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:51.467083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7bd53307-ce7b-40cf-b728-978bf85b5e62 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:51.467551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7bd53307-ce7b-40cf-b728-978bf85b5e62 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:51.603201 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7bd53307-ce7b-40cf-b728-978bf85b5e62 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:51.611269 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7bd53307-ce7b-40cf-b728-978bf85b5e62 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.155850 Jun 23 10:50:51.612180 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 77/152] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:51 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:52.239442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a82a6841-927f-47ce-8a8b-0c15440952ac tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:52.240042 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a82a6841-927f-47ce-8a8b-0c15440952ac tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:52.246141 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a82a6841-927f-47ce-8a8b-0c15440952ac tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:52.246744 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a82a6841-927f-47ce-8a8b-0c15440952ac tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:52.247360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a82a6841-927f-47ce-8a8b-0c15440952ac tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:52.247786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a82a6841-927f-47ce-8a8b-0c15440952ac tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:52.285041 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:52.285872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:52.293808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:52.294522 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:52.296043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:52.296543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:52.450262 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a82a6841-927f-47ce-8a8b-0c15440952ac tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:52.464113 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a82a6841-927f-47ce-8a8b-0c15440952ac tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.228290 Jun 23 10:50:52.473602 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 76/153] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:52 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:52.473602 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0f173ae8-faaf-434c-b225-616e0cdfe955 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:52.473602 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0f173ae8-faaf-434c-b225-616e0cdfe955 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:52.477399 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f173ae8-faaf-434c-b225-616e0cdfe955 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:52.477992 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f173ae8-faaf-434c-b225-616e0cdfe955 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:52.478845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f173ae8-faaf-434c-b225-616e0cdfe955 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:52.479284 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f173ae8-faaf-434c-b225-616e0cdfe955 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:52.493693 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:52.512218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:52.514017 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:52.515675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-772922f7-e144-4166-a2e5-3dfceae68c9d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.235626 Jun 23 10:50:52.518778 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 78/154] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:52 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:52.621875 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0f173ae8-faaf-434c-b225-616e0cdfe955 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:52.629259 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6b5e153e-1b25-4962-adbe-3bfbbd1aee13 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:52.630236 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6b5e153e-1b25-4962-adbe-3bfbbd1aee13 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:52.632562 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0f173ae8-faaf-434c-b225-616e0cdfe955 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.166542 Jun 23 10:50:52.633455 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 77/155] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:52 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:52.637531 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6b5e153e-1b25-4962-adbe-3bfbbd1aee13 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:52.638287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6b5e153e-1b25-4962-adbe-3bfbbd1aee13 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:52.639708 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6b5e153e-1b25-4962-adbe-3bfbbd1aee13 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:52.640149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6b5e153e-1b25-4962-adbe-3bfbbd1aee13 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:52.787159 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6b5e153e-1b25-4962-adbe-3bfbbd1aee13 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:52.794583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6b5e153e-1b25-4962-adbe-3bfbbd1aee13 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.171054 Jun 23 10:50:52.795166 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 79/156] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:52 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:53.480738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a0b5a240-bb93-4df0-9261-8a441c161885 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:53.481377 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a0b5a240-bb93-4df0-9261-8a441c161885 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:53.488189 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a0b5a240-bb93-4df0-9261-8a441c161885 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:53.488635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a0b5a240-bb93-4df0-9261-8a441c161885 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:53.489388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a0b5a240-bb93-4df0-9261-8a441c161885 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:53.489823 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a0b5a240-bb93-4df0-9261-8a441c161885 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:53.542699 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:53.543120 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:53.546023 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:53.553519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:53.553519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:53.554218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:53.556087 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:53.676787 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a0b5a240-bb93-4df0-9261-8a441c161885 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:53.684408 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a0b5a240-bb93-4df0-9261-8a441c161885 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.207447 Jun 23 10:50:53.685170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 78/157] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:53 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:53.690376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-26dc4bb3-a7ac-4433-b491-cba0b2b55432 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:53.690980 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-26dc4bb3-a7ac-4433-b491-cba0b2b55432 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:53.698621 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-26dc4bb3-a7ac-4433-b491-cba0b2b55432 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:53.699232 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-26dc4bb3-a7ac-4433-b491-cba0b2b55432 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:53.700136 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-26dc4bb3-a7ac-4433-b491-cba0b2b55432 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:53.700593 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-26dc4bb3-a7ac-4433-b491-cba0b2b55432 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:53.726455 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:53.734337 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:53.737231 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:53.738355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-25eefd79-0be1-4b59-8e65-e5309f7157e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.208815 Jun 23 10:50:53.739065 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 80/158] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:53 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:53.811799 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a9b38b80-c77a-4896-a914-82860516a22b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:53.812562 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a9b38b80-c77a-4896-a914-82860516a22b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:53.819200 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9b38b80-c77a-4896-a914-82860516a22b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:53.819738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9b38b80-c77a-4896-a914-82860516a22b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:53.820575 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9b38b80-c77a-4896-a914-82860516a22b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:53.821206 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9b38b80-c77a-4896-a914-82860516a22b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:53.845428 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-26dc4bb3-a7ac-4433-b491-cba0b2b55432 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:53.852901 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-26dc4bb3-a7ac-4433-b491-cba0b2b55432 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.166754 Jun 23 10:50:53.853690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 79/159] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:53 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:53.964839 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a9b38b80-c77a-4896-a914-82860516a22b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:53.972538 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a9b38b80-c77a-4896-a914-82860516a22b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.165193 Jun 23 10:50:53.973113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 81/160] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:53 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:54.701789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-db47a9d3-13b9-4b4e-b09d-96a75ec7fccc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:54.703167 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-db47a9d3-13b9-4b4e-b09d-96a75ec7fccc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:54.709813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db47a9d3-13b9-4b4e-b09d-96a75ec7fccc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:54.710582 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db47a9d3-13b9-4b4e-b09d-96a75ec7fccc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:54.711346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db47a9d3-13b9-4b4e-b09d-96a75ec7fccc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:54.711775 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db47a9d3-13b9-4b4e-b09d-96a75ec7fccc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:54.755823 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:54.756503 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:54.762273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:54.762741 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:54.763484 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:54.763997 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:54.889403 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-db47a9d3-13b9-4b4e-b09d-96a75ec7fccc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:54.899046 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-db47a9d3-13b9-4b4e-b09d-96a75ec7fccc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.199851 Jun 23 10:50:54.899046 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 80/161] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:54 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:54.902955 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-292c02b6-608b-4fe7-9867-116807a407ac tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:54.903553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-292c02b6-608b-4fe7-9867-116807a407ac tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:54.911998 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-292c02b6-608b-4fe7-9867-116807a407ac tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:54.912437 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-292c02b6-608b-4fe7-9867-116807a407ac tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:54.913197 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-292c02b6-608b-4fe7-9867-116807a407ac tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:54.913622 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-292c02b6-608b-4fe7-9867-116807a407ac tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:54.932047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:54.940475 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:54.941942 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:54.943064 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-42e43a0b-8da5-495b-8293-aa1b1cae9bd3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.191040 Jun 23 10:50:54.943620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 82/162] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:54 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:54.990098 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b45c2a28-c5c3-4a0e-bec3-b1f19a4903e5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:54.990908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b45c2a28-c5c3-4a0e-bec3-b1f19a4903e5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:54.997398 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b45c2a28-c5c3-4a0e-bec3-b1f19a4903e5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:54.997838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b45c2a28-c5c3-4a0e-bec3-b1f19a4903e5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:54.999181 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b45c2a28-c5c3-4a0e-bec3-b1f19a4903e5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:54.999690 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b45c2a28-c5c3-4a0e-bec3-b1f19a4903e5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:55.071145 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-292c02b6-608b-4fe7-9867-116807a407ac tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:55.079647 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-292c02b6-608b-4fe7-9867-116807a407ac tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.180966 Jun 23 10:50:55.080209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 81/163] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:54 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:55.149989 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b45c2a28-c5c3-4a0e-bec3-b1f19a4903e5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:55.160074 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b45c2a28-c5c3-4a0e-bec3-b1f19a4903e5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.174715 Jun 23 10:50:55.160655 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 83/164] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:54 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:55.915684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b99be47f-fac7-4099-b096-69046aa531ad tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:55.916529 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b99be47f-fac7-4099-b096-69046aa531ad tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:55.918751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:55.925002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b99be47f-fac7-4099-b096-69046aa531ad tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:55.925450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b99be47f-fac7-4099-b096-69046aa531ad tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:55.926217 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b99be47f-fac7-4099-b096-69046aa531ad tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:55.926819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b99be47f-fac7-4099-b096-69046aa531ad tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:55.967104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:55.967722 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:55.981061 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:55.981779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:55.983370 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:55.983957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:56.130090 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b99be47f-fac7-4099-b096-69046aa531ad tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:56.137586 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b99be47f-fac7-4099-b096-69046aa531ad tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.225761 Jun 23 10:50:56.138159 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 82/165] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:55 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:56.143877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-80152615-1760-4aeb-8855-4b9eae613868 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:56.144476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-80152615-1760-4aeb-8855-4b9eae613868 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:56.150721 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-80152615-1760-4aeb-8855-4b9eae613868 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:56.151172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-80152615-1760-4aeb-8855-4b9eae613868 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:56.151938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-80152615-1760-4aeb-8855-4b9eae613868 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:56.152371 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-80152615-1760-4aeb-8855-4b9eae613868 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:56.157924 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:56.165819 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:56.167317 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:56.168414 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-53fcc720-a096-4064-90e9-2549844c1ae1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.209875 Jun 23 10:50:56.168988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 84/166] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:55 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:50:56.177385 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fba25be6-8f7e-43af-adff-c6c9b4d2a831 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:56.177991 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fba25be6-8f7e-43af-adff-c6c9b4d2a831 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:56.184087 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fba25be6-8f7e-43af-adff-c6c9b4d2a831 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:56.184530 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fba25be6-8f7e-43af-adff-c6c9b4d2a831 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:56.185287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fba25be6-8f7e-43af-adff-c6c9b4d2a831 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:56.186283 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fba25be6-8f7e-43af-adff-c6c9b4d2a831 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:56.354487 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-80152615-1760-4aeb-8855-4b9eae613868 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:56.361786 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-fba25be6-8f7e-43af-adff-c6c9b4d2a831 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:56.369920 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fba25be6-8f7e-43af-adff-c6c9b4d2a831 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.196419 Jun 23 10:50:56.370258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-80152615-1760-4aeb-8855-4b9eae613868 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.229888 Jun 23 10:50:56.374682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 83/168] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:56 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:56.374840 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 85/168] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:56 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:57.156655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-621a493b-3a8c-491b-a7bc-f77f3145f05a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:57.157833 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-621a493b-3a8c-491b-a7bc-f77f3145f05a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:57.163998 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-621a493b-3a8c-491b-a7bc-f77f3145f05a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:57.164450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-621a493b-3a8c-491b-a7bc-f77f3145f05a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:57.165207 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-621a493b-3a8c-491b-a7bc-f77f3145f05a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:57.165711 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-621a493b-3a8c-491b-a7bc-f77f3145f05a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:57.187933 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:57.188682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:57.194949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:57.195515 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:57.196646 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:57.197176 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:57.359241 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-621a493b-3a8c-491b-a7bc-f77f3145f05a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:57.362762 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:57.367566 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-621a493b-3a8c-491b-a7bc-f77f3145f05a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.216325 Jun 23 10:50:57.368124 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 84/169] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:57 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:57.380278 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:57.386637 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-18559ebc-a6a0-4aa7-b29d-39eada0758c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:57.387241 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-18559ebc-a6a0-4aa7-b29d-39eada0758c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:57.390354 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:57.391870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:57.392965 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-56ba06e3-6350-498f-9e1c-af6d57ae20f2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.209996 Jun 23 10:50:57.393501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 86/170] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:57 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:57.393944 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18559ebc-a6a0-4aa7-b29d-39eada0758c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:57.394420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18559ebc-a6a0-4aa7-b29d-39eada0758c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:57.395191 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18559ebc-a6a0-4aa7-b29d-39eada0758c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:57.395623 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18559ebc-a6a0-4aa7-b29d-39eada0758c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:57.398459 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1aa1e0b3-8e27-4aaf-b54f-3762f9001648 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:57.399054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1aa1e0b3-8e27-4aaf-b54f-3762f9001648 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:57.405046 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1aa1e0b3-8e27-4aaf-b54f-3762f9001648 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:57.405664 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1aa1e0b3-8e27-4aaf-b54f-3762f9001648 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:57.406452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1aa1e0b3-8e27-4aaf-b54f-3762f9001648 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:57.406885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1aa1e0b3-8e27-4aaf-b54f-3762f9001648 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:57.589379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1aa1e0b3-8e27-4aaf-b54f-3762f9001648 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:57.592478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-18559ebc-a6a0-4aa7-b29d-39eada0758c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:57.597042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1aa1e0b3-8e27-4aaf-b54f-3762f9001648 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.202528 Jun 23 10:50:57.597608 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 87/171] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:57 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:57.600086 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-18559ebc-a6a0-4aa7-b29d-39eada0758c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.217165 Jun 23 10:50:57.600650 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 85/172] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:57 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:58.384107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-033106fe-028d-4719-a36f-167549d7d02a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:58.384715 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-033106fe-028d-4719-a36f-167549d7d02a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:58.391270 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-033106fe-028d-4719-a36f-167549d7d02a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:58.391719 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-033106fe-028d-4719-a36f-167549d7d02a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:58.392479 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-033106fe-028d-4719-a36f-167549d7d02a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:58.392914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-033106fe-028d-4719-a36f-167549d7d02a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:58.396920 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:58.411368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:58.411971 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:58.414865 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:58.418757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:58.419199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:58.420034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:58.420459 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:58.590877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-033106fe-028d-4719-a36f-167549d7d02a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:58.594894 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:58.598603 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-033106fe-028d-4719-a36f-167549d7d02a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.218260 Jun 23 10:50:58.599244 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 88/173] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:58 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:58.602764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:58.604262 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:58.605360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-60142700-62a6-4508-8385-df20eb8661aa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.197899 Jun 23 10:50:58.605906 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 86/174] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:58 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:58.613694 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-60c0d37d-a6d6-4a0a-b2e8-5b018c67bbc1 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:58.614304 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-60c0d37d-a6d6-4a0a-b2e8-5b018c67bbc1 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:58.616630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-90420818-7da0-4b3f-985a-c1ef70b3dc37 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:58.617140 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:58.617329 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-90420818-7da0-4b3f-985a-c1ef70b3dc37 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:58.621030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-60c0d37d-a6d6-4a0a-b2e8-5b018c67bbc1 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:58.621470 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-60c0d37d-a6d6-4a0a-b2e8-5b018c67bbc1 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:58.622288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-60c0d37d-a6d6-4a0a-b2e8-5b018c67bbc1 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:58.622678 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-60c0d37d-a6d6-4a0a-b2e8-5b018c67bbc1 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:58.624110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-90420818-7da0-4b3f-985a-c1ef70b3dc37 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:58.624645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-90420818-7da0-4b3f-985a-c1ef70b3dc37 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:58.625407 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-90420818-7da0-4b3f-985a-c1ef70b3dc37 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:58.625848 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-90420818-7da0-4b3f-985a-c1ef70b3dc37 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:58.820188 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-60c0d37d-a6d6-4a0a-b2e8-5b018c67bbc1 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:58.823686 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-90420818-7da0-4b3f-985a-c1ef70b3dc37 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:58.829113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-60c0d37d-a6d6-4a0a-b2e8-5b018c67bbc1 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.218984 Jun 23 10:50:58.829685 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 89/175] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:58 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:58.836588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-90420818-7da0-4b3f-985a-c1ef70b3dc37 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.223488 Jun 23 10:50:58.837213 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 87/176] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:58 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:59.615224 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b95b0729-c84f-4223-b366-70a8a2669631 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:59.615821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b95b0729-c84f-4223-b366-70a8a2669631 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:59.621752 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b95b0729-c84f-4223-b366-70a8a2669631 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:59.622189 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b95b0729-c84f-4223-b366-70a8a2669631 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:59.622738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:59.623240 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b95b0729-c84f-4223-b366-70a8a2669631 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:59.623376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:59.623480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b95b0729-c84f-4223-b366-70a8a2669631 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:59.629248 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:59.629699 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:59.630481 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:59.630915 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:59.816147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b95b0729-c84f-4223-b366-70a8a2669631 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:59.823835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b95b0729-c84f-4223-b366-70a8a2669631 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.212362 Jun 23 10:50:59.824414 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 90/177] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:59 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:59.827460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:59.835313 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:59.836785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:50:59.837861 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8cdfb209-f19b-40b1-ad6c-497b606076bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.218947 Jun 23 10:50:59.838416 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 88/178] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:50:59 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:50:59.847970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1ebe9644-9c3d-45c1-98a1-049059d5f844 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:59.848604 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1ebe9644-9c3d-45c1-98a1-049059d5f844 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:59.852872 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a52c598c-6903-4d31-934a-27996ef2e545 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:50:59.853583 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a52c598c-6903-4d31-934a-27996ef2e545 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:50:59.856567 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1ebe9644-9c3d-45c1-98a1-049059d5f844 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:59.857068 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1ebe9644-9c3d-45c1-98a1-049059d5f844 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:59.858408 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1ebe9644-9c3d-45c1-98a1-049059d5f844 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:59.858844 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1ebe9644-9c3d-45c1-98a1-049059d5f844 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:59.861395 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a52c598c-6903-4d31-934a-27996ef2e545 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:59.862089 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a52c598c-6903-4d31-934a-27996ef2e545 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:50:59.863127 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a52c598c-6903-4d31-934a-27996ef2e545 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:50:59.863758 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a52c598c-6903-4d31-934a-27996ef2e545 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:00.054602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1ebe9644-9c3d-45c1-98a1-049059d5f844 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:00.057883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a52c598c-6903-4d31-934a-27996ef2e545 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:00.063298 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1ebe9644-9c3d-45c1-98a1-049059d5f844 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.220909 Jun 23 10:51:00.063925 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 91/179] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:59 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:00.066394 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a52c598c-6903-4d31-934a-27996ef2e545 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.217247 Jun 23 10:51:00.074450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 89/180] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:50:59 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:00.840770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4a70056f-52ba-46ac-88ef-0ffda1a4e35b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:00.841376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4a70056f-52ba-46ac-88ef-0ffda1a4e35b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:00.847919 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a70056f-52ba-46ac-88ef-0ffda1a4e35b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:00.848360 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a70056f-52ba-46ac-88ef-0ffda1a4e35b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:00.849114 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a70056f-52ba-46ac-88ef-0ffda1a4e35b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:00.849580 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a70056f-52ba-46ac-88ef-0ffda1a4e35b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:00.855844 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:00.856439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:00.863047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:00.863481 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:00.864228 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:00.864652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:01.033236 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4a70056f-52ba-46ac-88ef-0ffda1a4e35b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:01.040531 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4a70056f-52ba-46ac-88ef-0ffda1a4e35b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.203592 Jun 23 10:51:01.041085 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 92/181] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:00 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:01.054583 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:01.062916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:01.064385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:01.065464 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3843eac5-ed22-49e1-84e7-b5a6152b58a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.213466 Jun 23 10:51:01.066002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 90/182] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:00 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:51:01.081061 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2b809b15-7185-4d4b-b5fe-1c2e164a6f25 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:01.081666 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2b809b15-7185-4d4b-b5fe-1c2e164a6f25 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:01.083055 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9b5b1ae1-88f0-402e-b1ba-01ca9c50bda1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:01.083664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9b5b1ae1-88f0-402e-b1ba-01ca9c50bda1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:01.087600 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2b809b15-7185-4d4b-b5fe-1c2e164a6f25 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:01.088081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2b809b15-7185-4d4b-b5fe-1c2e164a6f25 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:01.088837 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2b809b15-7185-4d4b-b5fe-1c2e164a6f25 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:01.089261 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2b809b15-7185-4d4b-b5fe-1c2e164a6f25 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:01.090188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b5b1ae1-88f0-402e-b1ba-01ca9c50bda1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:01.090287 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b5b1ae1-88f0-402e-b1ba-01ca9c50bda1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:01.091076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b5b1ae1-88f0-402e-b1ba-01ca9c50bda1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:01.091630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b5b1ae1-88f0-402e-b1ba-01ca9c50bda1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:01.290515 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2b809b15-7185-4d4b-b5fe-1c2e164a6f25 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:01.294379 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9b5b1ae1-88f0-402e-b1ba-01ca9c50bda1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:01.298846 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2b809b15-7185-4d4b-b5fe-1c2e164a6f25 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.222531 Jun 23 10:51:01.299564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 93/183] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:01 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:01.302276 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9b5b1ae1-88f0-402e-b1ba-01ca9c50bda1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.223040 Jun 23 10:51:01.302845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 91/184] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:01 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:02.057172 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-598a295f-b567-4c3c-a077-4eb5eb8a8823 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:02.057813 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-598a295f-b567-4c3c-a077-4eb5eb8a8823 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:02.063982 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-598a295f-b567-4c3c-a077-4eb5eb8a8823 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:02.064429 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-598a295f-b567-4c3c-a077-4eb5eb8a8823 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:02.065183 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-598a295f-b567-4c3c-a077-4eb5eb8a8823 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:02.065622 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-598a295f-b567-4c3c-a077-4eb5eb8a8823 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:02.083568 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:02.084205 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:02.090080 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:02.090555 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:02.091314 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:02.091758 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:02.272299 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-598a295f-b567-4c3c-a077-4eb5eb8a8823 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:02.283055 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-598a295f-b567-4c3c-a077-4eb5eb8a8823 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.229837 Jun 23 10:51:02.283815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 94/185] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:02 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:02.285807 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:02.295506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:02.297075 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:02.298209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a803005a-890e-473b-bb07-f18be81f8a2f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.218541 Jun 23 10:51:02.298798 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 92/186] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:02 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:51:02.315654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e4f8dfcc-db84-4559-ab40-a7ba9ced7295 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:02.316158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e4f8dfcc-db84-4559-ab40-a7ba9ced7295 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:02.319660 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d985f187-b89d-4a1e-85b2-5b19e4df1029 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:02.320349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d985f187-b89d-4a1e-85b2-5b19e4df1029 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:02.324506 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4f8dfcc-db84-4559-ab40-a7ba9ced7295 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:02.325135 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4f8dfcc-db84-4559-ab40-a7ba9ced7295 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:02.326054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4f8dfcc-db84-4559-ab40-a7ba9ced7295 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:02.326736 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4f8dfcc-db84-4559-ab40-a7ba9ced7295 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:02.328472 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d985f187-b89d-4a1e-85b2-5b19e4df1029 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:02.329020 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d985f187-b89d-4a1e-85b2-5b19e4df1029 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:02.329910 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d985f187-b89d-4a1e-85b2-5b19e4df1029 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:02.330477 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d985f187-b89d-4a1e-85b2-5b19e4df1029 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:02.533830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d985f187-b89d-4a1e-85b2-5b19e4df1029 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:02.537434 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e4f8dfcc-db84-4559-ab40-a7ba9ced7295 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:02.553280 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d985f187-b89d-4a1e-85b2-5b19e4df1029 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.237761 Jun 23 10:51:02.554161 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 93/187] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:02 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:02.555628 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e4f8dfcc-db84-4559-ab40-a7ba9ced7295 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.243799 Jun 23 10:51:02.556194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 95/188] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:02 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:03.300034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f07ef77a-bf0e-46d5-8373-8b0e6f5b62a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:03.300638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f07ef77a-bf0e-46d5-8373-8b0e6f5b62a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:03.306577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f07ef77a-bf0e-46d5-8373-8b0e6f5b62a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:03.307021 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f07ef77a-bf0e-46d5-8373-8b0e6f5b62a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:03.307780 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f07ef77a-bf0e-46d5-8373-8b0e6f5b62a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:03.308215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f07ef77a-bf0e-46d5-8373-8b0e6f5b62a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:03.315677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:03.316334 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:03.322219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:03.322958 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:03.323888 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:03.324331 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:03.508874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f07ef77a-bf0e-46d5-8373-8b0e6f5b62a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:03.517899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f07ef77a-bf0e-46d5-8373-8b0e6f5b62a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.221821 Jun 23 10:51:03.518851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 94/189] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:03 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:03.527545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:03.536599 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:03.538075 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:03.539206 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-52a8bd53-dc92-4a64-9483-008afdb50760 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.227323 Jun 23 10:51:03.539760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 96/190] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:03 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:51:03.570828 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-04e3c334-f2f0-40f4-a44e-80cfd719d511 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:03.571429 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-04e3c334-f2f0-40f4-a44e-80cfd719d511 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:03.573993 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-55928829-4ffb-4cd5-83d5-a601034f50cb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:03.574618 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-55928829-4ffb-4cd5-83d5-a601034f50cb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:03.578205 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-04e3c334-f2f0-40f4-a44e-80cfd719d511 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:03.578682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-04e3c334-f2f0-40f4-a44e-80cfd719d511 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:03.579441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-04e3c334-f2f0-40f4-a44e-80cfd719d511 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:03.579869 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-04e3c334-f2f0-40f4-a44e-80cfd719d511 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:03.581226 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-55928829-4ffb-4cd5-83d5-a601034f50cb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:03.581663 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-55928829-4ffb-4cd5-83d5-a601034f50cb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:03.582440 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-55928829-4ffb-4cd5-83d5-a601034f50cb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:03.582867 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-55928829-4ffb-4cd5-83d5-a601034f50cb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:03.781693 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-55928829-4ffb-4cd5-83d5-a601034f50cb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:03.784935 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-04e3c334-f2f0-40f4-a44e-80cfd719d511 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:03.789599 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-55928829-4ffb-4cd5-83d5-a601034f50cb tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.219554 Jun 23 10:51:03.800730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 97/191] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:03 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:03.801152 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-04e3c334-f2f0-40f4-a44e-80cfd719d511 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.225769 Jun 23 10:51:03.801152 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 95/192] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:03 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:04.540439 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5a489121-c40e-4fd7-a800-cc5f3497fd35 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:04.540439 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5a489121-c40e-4fd7-a800-cc5f3497fd35 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:04.556709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:04.557300 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:04.560170 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5a489121-c40e-4fd7-a800-cc5f3497fd35 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:04.560957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5a489121-c40e-4fd7-a800-cc5f3497fd35 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:04.561930 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5a489121-c40e-4fd7-a800-cc5f3497fd35 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:04.562503 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5a489121-c40e-4fd7-a800-cc5f3497fd35 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:04.574100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:04.574595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:04.575365 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:04.575793 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:04.900502 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:04.914128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:04.916991 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:04.931550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-466ab0eb-6fca-47f0-b038-be32c051c03c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.366334 Jun 23 10:51:04.942128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 96/193] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:04 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:51:04.942493 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5a489121-c40e-4fd7-a800-cc5f3497fd35 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:04.944514 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5a489121-c40e-4fd7-a800-cc5f3497fd35 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.410221 Jun 23 10:51:04.945973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3dba9ee2-0aac-4ee4-a834-c92aa16f68dc tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:04.946607 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3dba9ee2-0aac-4ee4-a834-c92aa16f68dc tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:04.958665 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 98/194] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:04 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:04.961392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3dba9ee2-0aac-4ee4-a834-c92aa16f68dc tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:04.962047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3dba9ee2-0aac-4ee4-a834-c92aa16f68dc tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:04.963086 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3dba9ee2-0aac-4ee4-a834-c92aa16f68dc tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:04.964491 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3dba9ee2-0aac-4ee4-a834-c92aa16f68dc tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:04.966098 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fc9f5ce1-4323-4948-8823-c2ae3a895245 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:04.967343 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fc9f5ce1-4323-4948-8823-c2ae3a895245 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:04.984802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fc9f5ce1-4323-4948-8823-c2ae3a895245 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:04.985256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fc9f5ce1-4323-4948-8823-c2ae3a895245 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:04.986059 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fc9f5ce1-4323-4948-8823-c2ae3a895245 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:04.986542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fc9f5ce1-4323-4948-8823-c2ae3a895245 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:05.192685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3dba9ee2-0aac-4ee4-a834-c92aa16f68dc tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:05.208053 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3dba9ee2-0aac-4ee4-a834-c92aa16f68dc tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.274731 Jun 23 10:51:05.208631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 97/195] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:04 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:05.244244 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-fc9f5ce1-4323-4948-8823-c2ae3a895245 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:05.252941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fc9f5ce1-4323-4948-8823-c2ae3a895245 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.295646 Jun 23 10:51:05.272401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 99/196] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:04 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:05.295058 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-0f5ba6a8-4dc7-444e-8cdf-b496a7e65b04 req-1ce52267-aad0-41ef-8bf1-48bfc9cb3c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdecdfe5-d298-4823-a396-cf390e769f92", "name": "network-vif-plugged", "status": "completed", "tag": "62749cc8-f2ed-4f3d-857d-f18de666a6ca"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:51:05.303831 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-0f5ba6a8-4dc7-444e-8cdf-b496a7e65b04 req-1ce52267-aad0-41ef-8bf1-48bfc9cb3c48 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:05.304518 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-0f5ba6a8-4dc7-444e-8cdf-b496a7e65b04 req-1ce52267-aad0-41ef-8bf1-48bfc9cb3c48 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:05.324109 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-0f5ba6a8-4dc7-444e-8cdf-b496a7e65b04 req-1ce52267-aad0-41ef-8bf1-48bfc9cb3c48 service nova] Creating event network-vif-plugged:62749cc8-f2ed-4f3d-857d-f18de666a6ca for instance bdecdfe5-d298-4823-a396-cf390e769f92 on hv-cinder-84614 Jun 23 10:51:05.330275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-0f5ba6a8-4dc7-444e-8cdf-b496a7e65b04 req-1ce52267-aad0-41ef-8bf1-48bfc9cb3c48 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120463 Jun 23 10:51:05.331151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 98/197] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:51:05.950142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:05.952008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:05.959514 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:05.959963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:05.961214 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:05.961665 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:05.964800 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cc856c1f-369c-48a9-95fe-bfbd1d7110b5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:05.965604 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-cc856c1f-369c-48a9-95fe-bfbd1d7110b5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:05.985048 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cc856c1f-369c-48a9-95fe-bfbd1d7110b5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:05.986883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cc856c1f-369c-48a9-95fe-bfbd1d7110b5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:05.991723 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cc856c1f-369c-48a9-95fe-bfbd1d7110b5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:05.996052 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cc856c1f-369c-48a9-95fe-bfbd1d7110b5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:06.409665 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:06.410663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cc856c1f-369c-48a9-95fe-bfbd1d7110b5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:06.423608 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-cc856c1f-369c-48a9-95fe-bfbd1d7110b5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.463926 Jun 23 10:51:06.426548 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:06.429160 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:06.430722 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-81135cbb-1d63-4be7-b890-ac3a6f15a544 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.484988 Jun 23 10:51:06.433510 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 99/198] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:05 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:06.442948 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 100/199] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:05 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:51:06.448885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5e9f7018-69ee-4529-9fe5-bdd20b054825 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:06.449855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5e9f7018-69ee-4529-9fe5-bdd20b054825 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:06.456707 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f6c4375a-59d6-40fb-a9d4-730d67d08aaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:06.457124 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e9f7018-69ee-4529-9fe5-bdd20b054825 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:06.457761 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e9f7018-69ee-4529-9fe5-bdd20b054825 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:06.458854 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e9f7018-69ee-4529-9fe5-bdd20b054825 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:06.459441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e9f7018-69ee-4529-9fe5-bdd20b054825 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:06.460867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f6c4375a-59d6-40fb-a9d4-730d67d08aaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:06.475832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6c4375a-59d6-40fb-a9d4-730d67d08aaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:06.476424 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6c4375a-59d6-40fb-a9d4-730d67d08aaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:06.477496 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6c4375a-59d6-40fb-a9d4-730d67d08aaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:06.480065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6c4375a-59d6-40fb-a9d4-730d67d08aaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:06.823241 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f6c4375a-59d6-40fb-a9d4-730d67d08aaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:06.835440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f6c4375a-59d6-40fb-a9d4-730d67d08aaa tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.400423 Jun 23 10:51:06.839159 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 100/200] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:06 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:06.998161 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5e9f7018-69ee-4529-9fe5-bdd20b054825 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:07.009122 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5e9f7018-69ee-4529-9fe5-bdd20b054825 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.564793 Jun 23 10:51:07.019508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 101/201] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:06 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:07.352092 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-f3e0c861-cc95-4075-bc6a-ef6331cb2fc7 req-ef593a1c-13a9-4f69-a3d6-88d0ef153225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737144bf-12fa-4bec-9855-65112e48ed69", "name": "network-vif-plugged", "status": "completed", "tag": "595093b4-73b8-48ea-94e4-d0a5a594b1ff"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:51:07.363661 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-f3e0c861-cc95-4075-bc6a-ef6331cb2fc7 req-ef593a1c-13a9-4f69-a3d6-88d0ef153225 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:07.364224 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-f3e0c861-cc95-4075-bc6a-ef6331cb2fc7 req-ef593a1c-13a9-4f69-a3d6-88d0ef153225 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:07.378101 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-f3e0c861-cc95-4075-bc6a-ef6331cb2fc7 req-ef593a1c-13a9-4f69-a3d6-88d0ef153225 service nova] Creating event network-vif-plugged:595093b4-73b8-48ea-94e4-d0a5a594b1ff for instance 737144bf-12fa-4bec-9855-65112e48ed69 on hv-cinder-84614 Jun 23 10:51:07.395751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-f3e0c861-cc95-4075-bc6a-ef6331cb2fc7 req-ef593a1c-13a9-4f69-a3d6-88d0ef153225 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048436 Jun 23 10:51:07.396359 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 101/202] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:51:07.441908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6d46c4b4-45eb-409e-8bee-04d959faab89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:07.442577 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6d46c4b4-45eb-409e-8bee-04d959faab89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:07.459176 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:07.459176 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:07.467684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d46c4b4-45eb-409e-8bee-04d959faab89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:07.468144 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d46c4b4-45eb-409e-8bee-04d959faab89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:07.471107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d46c4b4-45eb-409e-8bee-04d959faab89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:07.471581 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d46c4b4-45eb-409e-8bee-04d959faab89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:07.472144 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:07.472586 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:07.473340 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:07.476172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:07.739822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:07.746123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:07.749347 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:07.750875 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:07.752000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4bbcf8ff-a923-4a3f-b756-5faaf86ff3bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.306815 Jun 23 10:51:07.752668 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 102/203] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:07 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:51:07.830070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6d46c4b4-45eb-409e-8bee-04d959faab89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:07.837591 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6d46c4b4-45eb-409e-8bee-04d959faab89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.399844 Jun 23 10:51:07.842705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 102/204] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:07 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:07.858168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-86b67173-1276-45d3-9f2e-06c288f29e2c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:07.859155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-86b67173-1276-45d3-9f2e-06c288f29e2c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:07.870157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-86b67173-1276-45d3-9f2e-06c288f29e2c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:07.870157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-86b67173-1276-45d3-9f2e-06c288f29e2c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:07.870157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-86b67173-1276-45d3-9f2e-06c288f29e2c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:07.870157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-86b67173-1276-45d3-9f2e-06c288f29e2c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:08.028401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-266bb64b-82ee-4850-b641-177f593b3cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:08.029117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-266bb64b-82ee-4850-b641-177f593b3cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:08.038568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-266bb64b-82ee-4850-b641-177f593b3cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:08.041416 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-266bb64b-82ee-4850-b641-177f593b3cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:08.043823 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-266bb64b-82ee-4850-b641-177f593b3cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:08.044452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-266bb64b-82ee-4850-b641-177f593b3cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:08.072889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-86b67173-1276-45d3-9f2e-06c288f29e2c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:08.086011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-86b67173-1276-45d3-9f2e-06c288f29e2c tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.230318 Jun 23 10:51:08.088112 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 103/205] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:07 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:08.207120 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-266bb64b-82ee-4850-b641-177f593b3cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:08.215594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-266bb64b-82ee-4850-b641-177f593b3cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.191717 Jun 23 10:51:08.216173 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 103/206] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:08 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:08.770245 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:08.771019 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:08.778448 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:08.779155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:08.780591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:08.781061 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:08.855065 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1ba18a77-6b31-4054-a9e4-95dba6c8628f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:08.855684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1ba18a77-6b31-4054-a9e4-95dba6c8628f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:08.866193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1ba18a77-6b31-4054-a9e4-95dba6c8628f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:08.866669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1ba18a77-6b31-4054-a9e4-95dba6c8628f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:08.867446 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1ba18a77-6b31-4054-a9e4-95dba6c8628f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:08.867934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1ba18a77-6b31-4054-a9e4-95dba6c8628f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:08.974989 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:08.984003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:08.985870 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:08.987326 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a3fbb7a7-e843-44f5-bb84-eb2d987f9eac tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.221122 Jun 23 10:51:08.998594 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 104/207] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:08 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:51:09.104129 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-db475dac-d226-4ffc-8483-34998a7c2cd7 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:09.104910 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-db475dac-d226-4ffc-8483-34998a7c2cd7 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:09.124523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db475dac-d226-4ffc-8483-34998a7c2cd7 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:09.125064 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db475dac-d226-4ffc-8483-34998a7c2cd7 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:09.125908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db475dac-d226-4ffc-8483-34998a7c2cd7 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:09.126637 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db475dac-d226-4ffc-8483-34998a7c2cd7 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:09.341413 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1ba18a77-6b31-4054-a9e4-95dba6c8628f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:09.347190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:09.353049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1ba18a77-6b31-4054-a9e4-95dba6c8628f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.502393 Jun 23 10:51:09.364118 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 104/208] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:08 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:09.370212 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a35c23a0-7013-48bf-986d-03550c40ab3e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:09.370886 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a35c23a0-7013-48bf-986d-03550c40ab3e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:09.378489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a35c23a0-7013-48bf-986d-03550c40ab3e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:09.379135 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a35c23a0-7013-48bf-986d-03550c40ab3e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:09.380840 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a35c23a0-7013-48bf-986d-03550c40ab3e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:09.381399 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a35c23a0-7013-48bf-986d-03550c40ab3e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:09.569038 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-db475dac-d226-4ffc-8483-34998a7c2cd7 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:09.586024 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-db475dac-d226-4ffc-8483-34998a7c2cd7 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.486449 Jun 23 10:51:09.596495 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 105/209] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:09 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:09.603431 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-0245a1e4-e023-44f6-bdc9-180ed2eb6773 req-265e7be3-1bd9-4a70-a609-ab8ba716b53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737a2c37-15f8-4f42-a879-af5af910fd30", "name": "network-vif-plugged", "status": "completed", "tag": "025ad83b-3dde-441a-ae8a-ae243337df1c"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:51:09.612126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-0245a1e4-e023-44f6-bdc9-180ed2eb6773 req-265e7be3-1bd9-4a70-a609-ab8ba716b53c service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:09.612571 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-0245a1e4-e023-44f6-bdc9-180ed2eb6773 req-265e7be3-1bd9-4a70-a609-ab8ba716b53c service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:09.627445 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-0245a1e4-e023-44f6-bdc9-180ed2eb6773 req-265e7be3-1bd9-4a70-a609-ab8ba716b53c service nova] Creating event network-vif-plugged:025ad83b-3dde-441a-ae8a-ae243337df1c for instance 737a2c37-15f8-4f42-a879-af5af910fd30 on hv-cinder-84614 Jun 23 10:51:09.633343 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-0245a1e4-e023-44f6-bdc9-180ed2eb6773 req-265e7be3-1bd9-4a70-a609-ab8ba716b53c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035268 Jun 23 10:51:09.634022 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 106/210] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:51:09.687538 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a35c23a0-7013-48bf-986d-03550c40ab3e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:09.701668 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a35c23a0-7013-48bf-986d-03550c40ab3e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.332962 Jun 23 10:51:09.713099 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 105/211] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:09 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:10.006000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:10.006762 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:10.014729 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:10.015174 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:10.015931 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:10.016518 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:10.173386 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:10.183395 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:10.184953 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:10.186959 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-17fbafa1-cc6b-467f-bd9c-e454a6c32832 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.185584 Jun 23 10:51:10.187904 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 107/212] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:10 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:51:10.371265 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-60b88fe4-debb-47fd-86f0-f4c6eb263a8d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:10.372047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-60b88fe4-debb-47fd-86f0-f4c6eb263a8d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:10.379422 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-60b88fe4-debb-47fd-86f0-f4c6eb263a8d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:10.380048 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-60b88fe4-debb-47fd-86f0-f4c6eb263a8d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:10.380977 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-60b88fe4-debb-47fd-86f0-f4c6eb263a8d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:10.381566 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-60b88fe4-debb-47fd-86f0-f4c6eb263a8d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:10.582032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-60b88fe4-debb-47fd-86f0-f4c6eb263a8d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:10.602995 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-60b88fe4-debb-47fd-86f0-f4c6eb263a8d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.235940 Jun 23 10:51:10.604471 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-637d87c3-2db9-4d87-b5a3-3093232a3066 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:10.605369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-637d87c3-2db9-4d87-b5a3-3093232a3066 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:10.606119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 106/213] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:10 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:10.625192 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-637d87c3-2db9-4d87-b5a3-3093232a3066 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:10.626057 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-637d87c3-2db9-4d87-b5a3-3093232a3066 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:10.627053 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-637d87c3-2db9-4d87-b5a3-3093232a3066 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:10.627693 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-637d87c3-2db9-4d87-b5a3-3093232a3066 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:10.720196 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5e517454-116a-45b9-a3ad-08f64dfd5547 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:10.721320 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5e517454-116a-45b9-a3ad-08f64dfd5547 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:10.728066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e517454-116a-45b9-a3ad-08f64dfd5547 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:10.728503 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e517454-116a-45b9-a3ad-08f64dfd5547 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:10.729433 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e517454-116a-45b9-a3ad-08f64dfd5547 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:10.730013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e517454-116a-45b9-a3ad-08f64dfd5547 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:10.795760 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-637d87c3-2db9-4d87-b5a3-3093232a3066 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:10.805544 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-637d87c3-2db9-4d87-b5a3-3093232a3066 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.205672 Jun 23 10:51:10.806049 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 108/214] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:10 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:10.906746 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5e517454-116a-45b9-a3ad-08f64dfd5547 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:10.917976 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5e517454-116a-45b9-a3ad-08f64dfd5547 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.200830 Jun 23 10:51:10.929002 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 107/215] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:10 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:11.205806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:11.206535 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:11.217165 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:11.218526 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:11.220401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:11.224523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:11.401422 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:11.412331 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:11.413960 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:11.415246 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-da620bcf-7744-4a29-b74e-f78181b82fbf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.213973 Jun 23 10:51:11.416104 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 109/216] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:11 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:51:11.631108 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-30f138fb-89ea-4906-aea0-a25820c913c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:11.632757 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-30f138fb-89ea-4906-aea0-a25820c913c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:11.640343 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-30f138fb-89ea-4906-aea0-a25820c913c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:11.641435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-30f138fb-89ea-4906-aea0-a25820c913c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:11.642511 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-30f138fb-89ea-4906-aea0-a25820c913c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:11.643161 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-30f138fb-89ea-4906-aea0-a25820c913c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:11.794432 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-30f138fb-89ea-4906-aea0-a25820c913c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:11.806355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-30f138fb-89ea-4906-aea0-a25820c913c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.182029 Jun 23 10:51:11.807168 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 108/217] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:11 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:11.824129 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-62d296fd-4d9e-47ae-bde4-988b42bd3ccf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:11.824666 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-62d296fd-4d9e-47ae-bde4-988b42bd3ccf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:11.831751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62d296fd-4d9e-47ae-bde4-988b42bd3ccf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:11.832391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62d296fd-4d9e-47ae-bde4-988b42bd3ccf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:11.833589 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62d296fd-4d9e-47ae-bde4-988b42bd3ccf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:11.833589 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62d296fd-4d9e-47ae-bde4-988b42bd3ccf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:11.937914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-503c1e6d-3bd4-4f84-9ba6-31338699d779 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:11.938970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-503c1e6d-3bd4-4f84-9ba6-31338699d779 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:11.948573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-503c1e6d-3bd4-4f84-9ba6-31338699d779 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:11.949236 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-503c1e6d-3bd4-4f84-9ba6-31338699d779 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:11.950187 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-503c1e6d-3bd4-4f84-9ba6-31338699d779 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:11.952001 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-503c1e6d-3bd4-4f84-9ba6-31338699d779 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:11.976351 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-62d296fd-4d9e-47ae-bde4-988b42bd3ccf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:11.988288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-62d296fd-4d9e-47ae-bde4-988b42bd3ccf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.168361 Jun 23 10:51:11.990063 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 110/218] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:11 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:12.111819 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-503c1e6d-3bd4-4f84-9ba6-31338699d779 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:12.120391 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-503c1e6d-3bd4-4f84-9ba6-31338699d779 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.188619 Jun 23 10:51:12.129912 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 109/219] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:11 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:12.439794 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:12.440815 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:12.448474 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:12.449169 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:12.450376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:12.450812 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:12.712623 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:12.722392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:12.724005 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:12.726930 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d52254b9-9e32-43e1-99e3-3173228b4175 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.296539 Jun 23 10:51:12.727671 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 111/220] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:12 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:51:12.824521 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-68658d84-ad99-472a-8e94-16ccbb9b3d9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:12.825407 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-68658d84-ad99-472a-8e94-16ccbb9b3d9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:12.835237 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-68658d84-ad99-472a-8e94-16ccbb9b3d9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:12.835668 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-68658d84-ad99-472a-8e94-16ccbb9b3d9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:12.836432 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-68658d84-ad99-472a-8e94-16ccbb9b3d9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:12.836868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-68658d84-ad99-472a-8e94-16ccbb9b3d9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:13.009187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b090f7b4-ec9c-4b7c-8473-aa7006bd6b8d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:13.009808 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b090f7b4-ec9c-4b7c-8473-aa7006bd6b8d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:13.020966 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b090f7b4-ec9c-4b7c-8473-aa7006bd6b8d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:13.027057 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b090f7b4-ec9c-4b7c-8473-aa7006bd6b8d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:13.028132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b090f7b4-ec9c-4b7c-8473-aa7006bd6b8d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:13.028831 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b090f7b4-ec9c-4b7c-8473-aa7006bd6b8d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:13.103302 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-68658d84-ad99-472a-8e94-16ccbb9b3d9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:13.112602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-68658d84-ad99-472a-8e94-16ccbb9b3d9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.292372 Jun 23 10:51:13.113187 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 110/221] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:12 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:13.139517 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4e53f951-fa58-4ff1-944a-6689626ee6c1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:13.141831 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4e53f951-fa58-4ff1-944a-6689626ee6c1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:13.151830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4e53f951-fa58-4ff1-944a-6689626ee6c1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:13.159896 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4e53f951-fa58-4ff1-944a-6689626ee6c1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:13.161133 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4e53f951-fa58-4ff1-944a-6689626ee6c1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:13.162574 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4e53f951-fa58-4ff1-944a-6689626ee6c1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:13.334055 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b090f7b4-ec9c-4b7c-8473-aa7006bd6b8d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:13.344791 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b090f7b4-ec9c-4b7c-8473-aa7006bd6b8d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.341501 Jun 23 10:51:13.345577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 112/222] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:13 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:13.480159 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4e53f951-fa58-4ff1-944a-6689626ee6c1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:13.488621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4e53f951-fa58-4ff1-944a-6689626ee6c1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.354985 Jun 23 10:51:13.489279 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 111/223] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:13 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:13.745160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:13.746356 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:13.755213 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:13.757542 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:13.759443 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:13.760771 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:14.110360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:14.119738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:14.121807 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:14.137127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-cf2f1594-cb84-4dbe-ba96-10482beeec9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:14.137647 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-cf2f1594-cb84-4dbe-ba96-10482beeec9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:14.149206 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-454761c3-acbf-4dde-9af9-9961f178ba1d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.382047 Jun 23 10:51:14.149865 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 113/224] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:13 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:51:14.164798 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cf2f1594-cb84-4dbe-ba96-10482beeec9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:14.165256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cf2f1594-cb84-4dbe-ba96-10482beeec9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:14.171137 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cf2f1594-cb84-4dbe-ba96-10482beeec9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:14.171592 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cf2f1594-cb84-4dbe-ba96-10482beeec9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:14.361756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ab706da9-8f38-44d4-b8cb-37541f58e076 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:14.362894 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ab706da9-8f38-44d4-b8cb-37541f58e076 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:14.367728 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cf2f1594-cb84-4dbe-ba96-10482beeec9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:14.384212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ab706da9-8f38-44d4-b8cb-37541f58e076 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:14.384660 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ab706da9-8f38-44d4-b8cb-37541f58e076 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:14.385449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ab706da9-8f38-44d4-b8cb-37541f58e076 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:14.385855 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ab706da9-8f38-44d4-b8cb-37541f58e076 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:14.400183 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-cf2f1594-cb84-4dbe-ba96-10482beeec9c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.274245 Jun 23 10:51:14.401487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 112/225] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:14 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:14.505111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-658ae0bc-33fe-4e3c-affc-92a9f621cd93 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:14.505715 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-658ae0bc-33fe-4e3c-affc-92a9f621cd93 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:14.513186 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-658ae0bc-33fe-4e3c-affc-92a9f621cd93 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:14.514205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-658ae0bc-33fe-4e3c-affc-92a9f621cd93 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:14.515022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-658ae0bc-33fe-4e3c-affc-92a9f621cd93 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:14.515458 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-658ae0bc-33fe-4e3c-affc-92a9f621cd93 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:14.592412 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ab706da9-8f38-44d4-b8cb-37541f58e076 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:14.601002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ab706da9-8f38-44d4-b8cb-37541f58e076 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.243973 Jun 23 10:51:14.601582 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 114/226] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:14 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:14.708763 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-658ae0bc-33fe-4e3c-affc-92a9f621cd93 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:14.716636 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-658ae0bc-33fe-4e3c-affc-92a9f621cd93 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.215309 Jun 23 10:51:14.717959 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 113/227] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:14 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:15.167717 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:15.168450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:15.179618 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:15.180177 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:15.181047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:15.181964 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:15.194071 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-000d8076-425f-48fa-aeee-897b2551f943 req-2d33a0d1-3daf-4c6e-b9f0-68d7a12162ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288db671-2fdd-4a32-bc84-b325f6606ea1", "name": "network-vif-plugged", "status": "completed", "tag": "3f493c22-ce91-4339-80e5-f1905a1b0046"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:51:15.212222 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-000d8076-425f-48fa-aeee-897b2551f943 req-2d33a0d1-3daf-4c6e-b9f0-68d7a12162ca service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:15.212882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-000d8076-425f-48fa-aeee-897b2551f943 req-2d33a0d1-3daf-4c6e-b9f0-68d7a12162ca service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:15.242748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-000d8076-425f-48fa-aeee-897b2551f943 req-2d33a0d1-3daf-4c6e-b9f0-68d7a12162ca service nova] Creating event network-vif-plugged:3f493c22-ce91-4339-80e5-f1905a1b0046 for instance 288db671-2fdd-4a32-bc84-b325f6606ea1 on hv-cinder-84614 Jun 23 10:51:15.257236 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-000d8076-425f-48fa-aeee-897b2551f943 req-2d33a0d1-3daf-4c6e-b9f0-68d7a12162ca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068102 Jun 23 10:51:15.260214 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 114/228] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:51:15.437170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:15.447185 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8dc709ab-2f1b-4551-9755-2a3803033484 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:15.448286 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8dc709ab-2f1b-4551-9755-2a3803033484 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:15.454408 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:15.456424 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:15.459692 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e6de1695-933b-4057-9b32-68034ea7df98 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.295516 Jun 23 10:51:15.474799 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 115/229] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:15 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:51:15.477639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8dc709ab-2f1b-4551-9755-2a3803033484 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:15.478305 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8dc709ab-2f1b-4551-9755-2a3803033484 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:15.479283 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8dc709ab-2f1b-4551-9755-2a3803033484 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:15.479889 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8dc709ab-2f1b-4551-9755-2a3803033484 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:15.627259 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c1d76a5e-8188-4411-be5d-c0196b69c9bd tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:15.628283 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c1d76a5e-8188-4411-be5d-c0196b69c9bd tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:15.647899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c1d76a5e-8188-4411-be5d-c0196b69c9bd tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:15.648447 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c1d76a5e-8188-4411-be5d-c0196b69c9bd tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:15.649138 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c1d76a5e-8188-4411-be5d-c0196b69c9bd tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:15.649569 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c1d76a5e-8188-4411-be5d-c0196b69c9bd tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:15.672829 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8dc709ab-2f1b-4551-9755-2a3803033484 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:15.688510 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8dc709ab-2f1b-4551-9755-2a3803033484 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.267005 Jun 23 10:51:15.690075 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 115/230] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:15 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:15.739186 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-01b6daec-14b7-4585-8a6c-3f634868a1bf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:15.740093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-01b6daec-14b7-4585-8a6c-3f634868a1bf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:15.750337 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-01b6daec-14b7-4585-8a6c-3f634868a1bf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:15.750961 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-01b6daec-14b7-4585-8a6c-3f634868a1bf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:15.751925 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-01b6daec-14b7-4585-8a6c-3f634868a1bf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:15.752452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-01b6daec-14b7-4585-8a6c-3f634868a1bf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:15.991049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-01b6daec-14b7-4585-8a6c-3f634868a1bf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:16.002781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-01b6daec-14b7-4585-8a6c-3f634868a1bf tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.270993 Jun 23 10:51:16.003444 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c1d76a5e-8188-4411-be5d-c0196b69c9bd tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:16.004229 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 116/231] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:15 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:16.020068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c1d76a5e-8188-4411-be5d-c0196b69c9bd tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1315 microversion: 2.1 time: 0.405829 Jun 23 10:51:16.020933 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 116/232] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:15 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:16.477473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:16.478108 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:16.485780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:16.486612 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:16.488080 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:16.488582 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:16.704876 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:16.708480 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1588da9d-7789-43a0-b373-7c0a1db57c09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:16.709155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1588da9d-7789-43a0-b373-7c0a1db57c09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:16.715496 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:16.718114 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1588da9d-7789-43a0-b373-7c0a1db57c09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:16.718306 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:16.719350 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1588da9d-7789-43a0-b373-7c0a1db57c09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:16.719843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1cfad125-5f5b-4aad-9b67-5f81d5b054a1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1406 microversion: 2.20 time: 0.246115 Jun 23 10:51:16.720485 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1588da9d-7789-43a0-b373-7c0a1db57c09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:16.721167 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1588da9d-7789-43a0-b373-7c0a1db57c09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:16.722659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 117/233] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:16 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:51:16.879387 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1588da9d-7789-43a0-b373-7c0a1db57c09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:16.889524 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1588da9d-7789-43a0-b373-7c0a1db57c09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.184331 Jun 23 10:51:16.899728 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 117/234] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:16 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:17.021344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-72dfd4a9-0405-4a88-ba4b-382d01cf6f85 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:17.021994 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-72dfd4a9-0405-4a88-ba4b-382d01cf6f85 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:17.037423 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-46de52e2-efa9-42b6-a932-94dd18d4f163 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:17.038035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-46de52e2-efa9-42b6-a932-94dd18d4f163 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:17.041389 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-72dfd4a9-0405-4a88-ba4b-382d01cf6f85 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:17.042045 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-72dfd4a9-0405-4a88-ba4b-382d01cf6f85 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:17.043164 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-72dfd4a9-0405-4a88-ba4b-382d01cf6f85 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:17.043598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-72dfd4a9-0405-4a88-ba4b-382d01cf6f85 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:17.047712 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-46de52e2-efa9-42b6-a932-94dd18d4f163 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:17.048139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-46de52e2-efa9-42b6-a932-94dd18d4f163 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:17.052537 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-46de52e2-efa9-42b6-a932-94dd18d4f163 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:17.053251 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-46de52e2-efa9-42b6-a932-94dd18d4f163 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:17.508524 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-72dfd4a9-0405-4a88-ba4b-382d01cf6f85 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:17.520114 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-46de52e2-efa9-42b6-a932-94dd18d4f163 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:17.527003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-72dfd4a9-0405-4a88-ba4b-382d01cf6f85 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.510295 Jun 23 10:51:17.527808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 118/235] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:17 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:17.529221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-46de52e2-efa9-42b6-a932-94dd18d4f163 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1502 microversion: 2.1 time: 0.495868 Jun 23 10:51:17.532531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 118/236] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:17 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1502 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:17.540924 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-16bffc6d-fe8d-4979-a851-7e88473c7640 req-77dadb68-1ad0-4426-a4a8-a573f5ace37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14d1ef1-2756-4058-a3e8-52c83a121833", "name": "network-vif-plugged", "status": "completed", "tag": "9c57cf5e-0cd4-4e3a-9734-57918143c3e0"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:51:17.551289 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-16bffc6d-fe8d-4979-a851-7e88473c7640 req-77dadb68-1ad0-4426-a4a8-a573f5ace37f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:17.551855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-16bffc6d-fe8d-4979-a851-7e88473c7640 req-77dadb68-1ad0-4426-a4a8-a573f5ace37f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:17.568437 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-16bffc6d-fe8d-4979-a851-7e88473c7640 req-77dadb68-1ad0-4426-a4a8-a573f5ace37f service nova] Creating event network-vif-plugged:9c57cf5e-0cd4-4e3a-9734-57918143c3e0 for instance b14d1ef1-2756-4058-a3e8-52c83a121833 on hv-cinder-84614 Jun 23 10:51:17.573910 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-16bffc6d-fe8d-4979-a851-7e88473c7640 req-77dadb68-1ad0-4426-a4a8-a573f5ace37f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044752 Jun 23 10:51:17.574814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 119/237] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:51:17.738535 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:17.739277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:17.745599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:17.746038 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:17.746866 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:17.747288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:17.912772 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f999743d-f75c-439b-a2b4-1957bedd06bd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:17.918804 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f999743d-f75c-439b-a2b4-1957bedd06bd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:17.920194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:17.943212 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f999743d-f75c-439b-a2b4-1957bedd06bd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:17.943809 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f999743d-f75c-439b-a2b4-1957bedd06bd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:17.944643 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f999743d-f75c-439b-a2b4-1957bedd06bd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:17.945079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f999743d-f75c-439b-a2b4-1957bedd06bd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:17.960238 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:17.964616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:17.969065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5e10fc88-b8e6-41a8-86b7-09484f22d2cf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1598 microversion: 2.20 time: 0.232144 Jun 23 10:51:17.971155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 119/238] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:51:17 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1598 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:51:17.993239 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9e1dac6d-86ee-4788-a09e-07f605375c3c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:17.996635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9e1dac6d-86ee-4788-a09e-07f605375c3c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:18.007406 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e1dac6d-86ee-4788-a09e-07f605375c3c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:18.008307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e1dac6d-86ee-4788-a09e-07f605375c3c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:18.010147 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e1dac6d-86ee-4788-a09e-07f605375c3c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:18.010790 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e1dac6d-86ee-4788-a09e-07f605375c3c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:18.055751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:18.165276 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f999743d-f75c-439b-a2b4-1957bedd06bd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:18.173973 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f999743d-f75c-439b-a2b4-1957bedd06bd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.270357 Jun 23 10:51:18.174824 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 120/239] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:17 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:18.186144 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9e1dac6d-86ee-4788-a09e-07f605375c3c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.200099 Jun 23 10:51:18.186753 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 120/240] 10.222.0.39 () {60 vars in 1315 bytes} [Thu Jun 23 10:51:17 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:18.545660 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d10a1451-45af-4da2-bf25-8f1754bb3169 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:18.546275 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d10a1451-45af-4da2-bf25-8f1754bb3169 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:18.555041 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d10a1451-45af-4da2-bf25-8f1754bb3169 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:18.561568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d10a1451-45af-4da2-bf25-8f1754bb3169 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:18.562986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d10a1451-45af-4da2-bf25-8f1754bb3169 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:18.564257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d10a1451-45af-4da2-bf25-8f1754bb3169 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:19.133639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d10a1451-45af-4da2-bf25-8f1754bb3169 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:19.142672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d10a1451-45af-4da2-bf25-8f1754bb3169 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.601570 Jun 23 10:51:19.143249 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 121/241] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:18 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:19.191834 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-20f2594b-d640-4f4d-9cad-2d5186d108d5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:19.193488 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-20f2594b-d640-4f4d-9cad-2d5186d108d5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:19.200775 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-20f2594b-d640-4f4d-9cad-2d5186d108d5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:19.201462 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-20f2594b-d640-4f4d-9cad-2d5186d108d5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:19.202489 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-20f2594b-d640-4f4d-9cad-2d5186d108d5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:19.203083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-20f2594b-d640-4f4d-9cad-2d5186d108d5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:19.456483 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-20f2594b-d640-4f4d-9cad-2d5186d108d5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:19.472720 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-20f2594b-d640-4f4d-9cad-2d5186d108d5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1322 microversion: 2.1 time: 0.284872 Jun 23 10:51:19.482188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 121/242] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:19 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:19.487908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-36516486-70ce-4154-8d68-037ff219798d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6199aad-f595-43f5-a0dd-e6a702711d1a"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:51:19.488971 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-36516486-70ce-4154-8d68-037ff219798d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:19.495314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-36516486-70ce-4154-8d68-037ff219798d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:19.495765 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-36516486-70ce-4154-8d68-037ff219798d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:19.496538 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-36516486-70ce-4154-8d68-037ff219798d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:19.496980 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-36516486-70ce-4154-8d68-037ff219798d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:19.662491 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:19.934213 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-141f432c-f3b5-440e-8dc3-7c485a3d342a req-88152b28-1ae0-4620-8dc4-c3424660bf85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "737a2c37-15f8-4f42-a879-af5af910fd30", "tag": "025ad83b-3dde-441a-ae8a-ae243337df1c"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:51:19.942869 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-141f432c-f3b5-440e-8dc3-7c485a3d342a req-88152b28-1ae0-4620-8dc4-c3424660bf85 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:19.943310 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-141f432c-f3b5-440e-8dc3-7c485a3d342a req-88152b28-1ae0-4620-8dc4-c3424660bf85 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:19.956027 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-141f432c-f3b5-440e-8dc3-7c485a3d342a req-88152b28-1ae0-4620-8dc4-c3424660bf85 service nova] Creating event network-changed:025ad83b-3dde-441a-ae8a-ae243337df1c for instance 737a2c37-15f8-4f42-a879-af5af910fd30 on hv-cinder-84614 Jun 23 10:51:19.961914 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-141f432c-f3b5-440e-8dc3-7c485a3d342a req-88152b28-1ae0-4620-8dc4-c3424660bf85 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031530 Jun 23 10:51:19.962714 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 122/243] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:51:20.161995 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b32c1bb4-2965-402c-8827-f1b9500d82ff tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:20.162812 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b32c1bb4-2965-402c-8827-f1b9500d82ff tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:20.169507 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b32c1bb4-2965-402c-8827-f1b9500d82ff tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:20.169965 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b32c1bb4-2965-402c-8827-f1b9500d82ff tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:20.171024 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b32c1bb4-2965-402c-8827-f1b9500d82ff tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:20.171632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b32c1bb4-2965-402c-8827-f1b9500d82ff tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:20.317572 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b32c1bb4-2965-402c-8827-f1b9500d82ff tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:20.325327 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b32c1bb4-2965-402c-8827-f1b9500d82ff tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.167799 Jun 23 10:51:20.326446 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 123/244] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:20 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:20.488993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f023ad14-d3ed-4fca-8f20-1ca887ded412 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:20.489625 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f023ad14-d3ed-4fca-8f20-1ca887ded412 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:20.495840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f023ad14-d3ed-4fca-8f20-1ca887ded412 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:20.496402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f023ad14-d3ed-4fca-8f20-1ca887ded412 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:20.497180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f023ad14-d3ed-4fca-8f20-1ca887ded412 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:20.498159 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f023ad14-d3ed-4fca-8f20-1ca887ded412 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:20.641206 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f023ad14-d3ed-4fca-8f20-1ca887ded412 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:20.649700 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f023ad14-d3ed-4fca-8f20-1ca887ded412 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1516 microversion: 2.1 time: 0.164500 Jun 23 10:51:20.650403 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 124/245] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:20 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:20.666719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-929384bd-6345-45ad-8c75-932afdc67064 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:51:20.667700 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-929384bd-6345-45ad-8c75-932afdc67064 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:20.674498 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-929384bd-6345-45ad-8c75-932afdc67064 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:20.674973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-929384bd-6345-45ad-8c75-932afdc67064 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:20.675725 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-929384bd-6345-45ad-8c75-932afdc67064 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:20.676224 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-929384bd-6345-45ad-8c75-932afdc67064 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:20.700421 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-929384bd-6345-45ad-8c75-932afdc67064 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lazy-loading 'flavor' on Instance uuid 288db671-2fdd-4a32-bc84-b325f6606ea1 {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:51:20.827398 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-929384bd-6345-45ad-8c75-932afdc67064 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1/action" status: 200 len: 32 microversion: 2.1 time: 0.164559 Jun 23 10:51:20.828016 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 125/246] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:51:20 2022] POST /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 10:51:20.837650 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8465b714-dd41-4605-8bf9-484df0086917 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:20.838409 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8465b714-dd41-4605-8bf9-484df0086917 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:20.845275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8465b714-dd41-4605-8bf9-484df0086917 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:20.845731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8465b714-dd41-4605-8bf9-484df0086917 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:20.846568 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8465b714-dd41-4605-8bf9-484df0086917 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:20.847011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8465b714-dd41-4605-8bf9-484df0086917 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:20.990215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8465b714-dd41-4605-8bf9-484df0086917 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:20.998509 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8465b714-dd41-4605-8bf9-484df0086917 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.164719 Jun 23 10:51:20.999273 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 126/247] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:20 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:21.344914 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7b1ed1d9-8da5-47bf-b5f8-ed110844a0c8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:21.346134 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7b1ed1d9-8da5-47bf-b5f8-ed110844a0c8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:21.355873 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7b1ed1d9-8da5-47bf-b5f8-ed110844a0c8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:21.356692 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7b1ed1d9-8da5-47bf-b5f8-ed110844a0c8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:21.358121 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7b1ed1d9-8da5-47bf-b5f8-ed110844a0c8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:21.358682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7b1ed1d9-8da5-47bf-b5f8-ed110844a0c8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:21.511227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7b1ed1d9-8da5-47bf-b5f8-ed110844a0c8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:21.519571 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7b1ed1d9-8da5-47bf-b5f8-ed110844a0c8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.179537 Jun 23 10:51:21.520413 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 127/248] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:21 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:22.015895 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6dadf1e8-dc6d-42f2-a165-18268fcc1227 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:22.016494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6dadf1e8-dc6d-42f2-a165-18268fcc1227 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:22.023581 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6dadf1e8-dc6d-42f2-a165-18268fcc1227 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:22.023581 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6dadf1e8-dc6d-42f2-a165-18268fcc1227 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:22.023927 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6dadf1e8-dc6d-42f2-a165-18268fcc1227 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:22.024359 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6dadf1e8-dc6d-42f2-a165-18268fcc1227 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:22.164650 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6dadf1e8-dc6d-42f2-a165-18268fcc1227 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:22.176629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6dadf1e8-dc6d-42f2-a165-18268fcc1227 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.165007 Jun 23 10:51:22.177126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 128/249] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:22 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:22.537111 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3934dc1d-2b3e-4ba8-93d4-f7ce875dd8a9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:22.537744 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3934dc1d-2b3e-4ba8-93d4-f7ce875dd8a9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:22.546029 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3934dc1d-2b3e-4ba8-93d4-f7ce875dd8a9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:22.546512 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3934dc1d-2b3e-4ba8-93d4-f7ce875dd8a9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:22.547273 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3934dc1d-2b3e-4ba8-93d4-f7ce875dd8a9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:22.547698 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3934dc1d-2b3e-4ba8-93d4-f7ce875dd8a9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:22.686431 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3934dc1d-2b3e-4ba8-93d4-f7ce875dd8a9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:22.693964 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3934dc1d-2b3e-4ba8-93d4-f7ce875dd8a9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.160811 Jun 23 10:51:22.694622 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 129/250] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:22 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:23.198490 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6d951bf8-ca29-43e6-8ae9-34325f47fc48 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:23.199095 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6d951bf8-ca29-43e6-8ae9-34325f47fc48 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:23.205390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d951bf8-ca29-43e6-8ae9-34325f47fc48 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:23.205907 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d951bf8-ca29-43e6-8ae9-34325f47fc48 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:23.206761 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d951bf8-ca29-43e6-8ae9-34325f47fc48 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:23.207192 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d951bf8-ca29-43e6-8ae9-34325f47fc48 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:23.361635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6d951bf8-ca29-43e6-8ae9-34325f47fc48 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:23.369250 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6d951bf8-ca29-43e6-8ae9-34325f47fc48 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.175465 Jun 23 10:51:23.369804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 130/251] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:23 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:23.711102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ee3a0156-a9ad-4dc8-8f23-c033d571702c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:23.711876 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ee3a0156-a9ad-4dc8-8f23-c033d571702c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:23.718648 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ee3a0156-a9ad-4dc8-8f23-c033d571702c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:23.719088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ee3a0156-a9ad-4dc8-8f23-c033d571702c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:23.719831 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ee3a0156-a9ad-4dc8-8f23-c033d571702c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:23.720257 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ee3a0156-a9ad-4dc8-8f23-c033d571702c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:23.851069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ee3a0156-a9ad-4dc8-8f23-c033d571702c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:23.858516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ee3a0156-a9ad-4dc8-8f23-c033d571702c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.151164 Jun 23 10:51:23.859065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 131/252] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:23 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:24.386266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7738b064-564b-4dd9-b7e3-de7fa6093a41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:24.386895 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7738b064-564b-4dd9-b7e3-de7fa6093a41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:24.393352 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7738b064-564b-4dd9-b7e3-de7fa6093a41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:24.393800 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7738b064-564b-4dd9-b7e3-de7fa6093a41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:24.394588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7738b064-564b-4dd9-b7e3-de7fa6093a41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:24.395052 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7738b064-564b-4dd9-b7e3-de7fa6093a41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:24.525607 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7738b064-564b-4dd9-b7e3-de7fa6093a41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:24.533416 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7738b064-564b-4dd9-b7e3-de7fa6093a41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.150902 Jun 23 10:51:24.534196 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 132/253] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:24 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:24.875152 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f2653cb4-6873-4b74-836c-5f558bd47e3a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:24.875740 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f2653cb4-6873-4b74-836c-5f558bd47e3a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:24.881713 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f2653cb4-6873-4b74-836c-5f558bd47e3a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:24.882223 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f2653cb4-6873-4b74-836c-5f558bd47e3a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:24.883054 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f2653cb4-6873-4b74-836c-5f558bd47e3a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:24.883483 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f2653cb4-6873-4b74-836c-5f558bd47e3a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:25.012140 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f2653cb4-6873-4b74-836c-5f558bd47e3a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:25.019607 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f2653cb4-6873-4b74-836c-5f558bd47e3a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.148555 Jun 23 10:51:25.020164 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 133/254] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:24 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:25.550266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-dc4bddc7-5834-40d8-96f3-2828460053e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:25.550941 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-dc4bddc7-5834-40d8-96f3-2828460053e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:25.557211 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc4bddc7-5834-40d8-96f3-2828460053e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:25.557654 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc4bddc7-5834-40d8-96f3-2828460053e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:25.558426 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc4bddc7-5834-40d8-96f3-2828460053e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:25.559165 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc4bddc7-5834-40d8-96f3-2828460053e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:25.690616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dc4bddc7-5834-40d8-96f3-2828460053e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:25.698292 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-dc4bddc7-5834-40d8-96f3-2828460053e4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.151728 Jun 23 10:51:25.698947 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 134/255] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:25 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:26.036270 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1a221352-f998-40b3-b02b-723af0e30a31 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:26.036917 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1a221352-f998-40b3-b02b-723af0e30a31 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:26.042827 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1a221352-f998-40b3-b02b-723af0e30a31 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:26.043260 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1a221352-f998-40b3-b02b-723af0e30a31 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:26.044007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1a221352-f998-40b3-b02b-723af0e30a31 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:26.044927 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1a221352-f998-40b3-b02b-723af0e30a31 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:26.181688 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1a221352-f998-40b3-b02b-723af0e30a31 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:26.189859 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:26.193296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1a221352-f998-40b3-b02b-723af0e30a31 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1367 microversion: 2.1 time: 0.160658 Jun 23 10:51:26.195762 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 135/256] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:26 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:51:26.455967 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-36516486-70ce-4154-8d68-037ff219798d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "POST /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.971895 Jun 23 10:51:26.457132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 122/257] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 10:51:19 2022] POST /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69/os-volume_attachments => generated 194 bytes in 6974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:51:26.719904 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1baee1b0-a1be-4c84-ac22-5d242f537b82 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:26.719904 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1baee1b0-a1be-4c84-ac22-5d242f537b82 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:26.740569 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:26.752699 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1baee1b0-a1be-4c84-ac22-5d242f537b82 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:26.754145 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1baee1b0-a1be-4c84-ac22-5d242f537b82 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:26.757224 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1baee1b0-a1be-4c84-ac22-5d242f537b82 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:26.757698 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1baee1b0-a1be-4c84-ac22-5d242f537b82 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:26.908063 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1baee1b0-a1be-4c84-ac22-5d242f537b82 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:26.915809 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1baee1b0-a1be-4c84-ac22-5d242f537b82 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.203065 Jun 23 10:51:26.916381 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 136/258] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:26 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:27.213271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-19619ffa-282a-4f79-8220-8b5a5bc9e4ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:27.213994 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-19619ffa-282a-4f79-8220-8b5a5bc9e4ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:27.223253 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-19619ffa-282a-4f79-8220-8b5a5bc9e4ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:27.223994 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-19619ffa-282a-4f79-8220-8b5a5bc9e4ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:27.226780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-19619ffa-282a-4f79-8220-8b5a5bc9e4ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:27.227637 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-19619ffa-282a-4f79-8220-8b5a5bc9e4ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:27.433303 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-19619ffa-282a-4f79-8220-8b5a5bc9e4ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:27.447112 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-19619ffa-282a-4f79-8220-8b5a5bc9e4ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1556 microversion: 2.1 time: 0.238535 Jun 23 10:51:27.448142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 123/259] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:27 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:27.465892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-23305dd7-d57e-4b75-9455-791dd620a409 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:27.467122 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-23305dd7-d57e-4b75-9455-791dd620a409 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:27.474006 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-23305dd7-d57e-4b75-9455-791dd620a409 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:27.474806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-23305dd7-d57e-4b75-9455-791dd620a409 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:27.475781 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-23305dd7-d57e-4b75-9455-791dd620a409 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:27.476411 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-23305dd7-d57e-4b75-9455-791dd620a409 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:27.606820 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-23305dd7-d57e-4b75-9455-791dd620a409 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145152 Jun 23 10:51:27.607503 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 137/260] 10.222.0.39 () {58 vars in 1274 bytes} [Thu Jun 23 10:51:27 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:51:27.933797 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-12a0562d-281c-4529-a66d-a2b65484d503 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:27.934369 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-12a0562d-281c-4529-a66d-a2b65484d503 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:27.943436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-12a0562d-281c-4529-a66d-a2b65484d503 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:27.944179 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-12a0562d-281c-4529-a66d-a2b65484d503 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:27.944945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-12a0562d-281c-4529-a66d-a2b65484d503 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:27.946150 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-12a0562d-281c-4529-a66d-a2b65484d503 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:28.159915 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-12a0562d-281c-4529-a66d-a2b65484d503 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:28.168519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-12a0562d-281c-4529-a66d-a2b65484d503 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.239058 Jun 23 10:51:28.170090 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 124/261] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:27 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:28.912959 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-2fd931f0-0175-474c-b672-e0a8ffe03c3b req-de936852-f2a8-41b9-a6a4-715c1e3bd0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b14d1ef1-2756-4058-a3e8-52c83a121833", "tag": "9c57cf5e-0cd4-4e3a-9734-57918143c3e0"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:51:28.928592 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-2fd931f0-0175-474c-b672-e0a8ffe03c3b req-de936852-f2a8-41b9-a6a4-715c1e3bd0a2 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:28.929187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-2fd931f0-0175-474c-b672-e0a8ffe03c3b req-de936852-f2a8-41b9-a6a4-715c1e3bd0a2 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:28.942489 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-2fd931f0-0175-474c-b672-e0a8ffe03c3b req-de936852-f2a8-41b9-a6a4-715c1e3bd0a2 service nova] Creating event network-changed:9c57cf5e-0cd4-4e3a-9734-57918143c3e0 for instance b14d1ef1-2756-4058-a3e8-52c83a121833 on hv-cinder-84614 Jun 23 10:51:28.948896 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-2fd931f0-0175-474c-b672-e0a8ffe03c3b req-de936852-f2a8-41b9-a6a4-715c1e3bd0a2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042498 Jun 23 10:51:28.949533 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 138/262] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:51:29.189784 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-62a8ad4b-2295-4cac-8ee9-855423480ac2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:29.190619 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-62a8ad4b-2295-4cac-8ee9-855423480ac2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:29.202992 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=71 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:29.205214 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-62a8ad4b-2295-4cac-8ee9-855423480ac2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:29.205777 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-62a8ad4b-2295-4cac-8ee9-855423480ac2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:29.206699 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-62a8ad4b-2295-4cac-8ee9-855423480ac2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:29.207470 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-62a8ad4b-2295-4cac-8ee9-855423480ac2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:29.351212 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-62a8ad4b-2295-4cac-8ee9-855423480ac2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:29.359109 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-62a8ad4b-2295-4cac-8ee9-855423480ac2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.175792 Jun 23 10:51:29.359979 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 125/263] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:29 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:30.377893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e3823967-798a-422a-acf4-5ac6f87d35dc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:30.378701 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e3823967-798a-422a-acf4-5ac6f87d35dc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:30.385438 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e3823967-798a-422a-acf4-5ac6f87d35dc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:30.385933 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e3823967-798a-422a-acf4-5ac6f87d35dc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:30.386723 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e3823967-798a-422a-acf4-5ac6f87d35dc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:30.387385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e3823967-798a-422a-acf4-5ac6f87d35dc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:30.533943 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e3823967-798a-422a-acf4-5ac6f87d35dc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:30.542758 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e3823967-798a-422a-acf4-5ac6f87d35dc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.170659 Jun 23 10:51:30.543324 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 139/264] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:30 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:31.560974 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3972ac16-b3c7-48aa-8ac6-a1ffd4f6609b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:31.562258 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3972ac16-b3c7-48aa-8ac6-a1ffd4f6609b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:31.569063 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3972ac16-b3c7-48aa-8ac6-a1ffd4f6609b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:31.569500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3972ac16-b3c7-48aa-8ac6-a1ffd4f6609b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:31.570251 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3972ac16-b3c7-48aa-8ac6-a1ffd4f6609b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:31.570721 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3972ac16-b3c7-48aa-8ac6-a1ffd4f6609b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:31.718862 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3972ac16-b3c7-48aa-8ac6-a1ffd4f6609b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:31.726600 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3972ac16-b3c7-48aa-8ac6-a1ffd4f6609b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.169851 Jun 23 10:51:31.727323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 126/265] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:31 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:32.743797 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0dd9731d-33ba-4bd5-aa08-41fee8f15c2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:32.744401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0dd9731d-33ba-4bd5-aa08-41fee8f15c2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:32.751060 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dd9731d-33ba-4bd5-aa08-41fee8f15c2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:32.751500 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dd9731d-33ba-4bd5-aa08-41fee8f15c2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:32.752252 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dd9731d-33ba-4bd5-aa08-41fee8f15c2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:32.752682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dd9731d-33ba-4bd5-aa08-41fee8f15c2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:32.879896 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0dd9731d-33ba-4bd5-aa08-41fee8f15c2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:32.887251 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0dd9731d-33ba-4bd5-aa08-41fee8f15c2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.147265 Jun 23 10:51:32.887822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 140/266] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:32 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:33.904335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b140c95a-f1b6-4e13-a393-c57197ca0f87 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:33.904946 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b140c95a-f1b6-4e13-a393-c57197ca0f87 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:33.911383 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b140c95a-f1b6-4e13-a393-c57197ca0f87 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:33.911844 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b140c95a-f1b6-4e13-a393-c57197ca0f87 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:33.912578 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b140c95a-f1b6-4e13-a393-c57197ca0f87 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:33.913011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b140c95a-f1b6-4e13-a393-c57197ca0f87 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:34.046930 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b140c95a-f1b6-4e13-a393-c57197ca0f87 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:34.054366 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b140c95a-f1b6-4e13-a393-c57197ca0f87 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.154181 Jun 23 10:51:34.054919 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 127/267] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:33 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:35.071843 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-15f3a8e7-2e7e-49db-9533-286825151783 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:35.072449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-15f3a8e7-2e7e-49db-9533-286825151783 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:35.079346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-15f3a8e7-2e7e-49db-9533-286825151783 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:35.079785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-15f3a8e7-2e7e-49db-9533-286825151783 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:35.080542 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-15f3a8e7-2e7e-49db-9533-286825151783 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:35.080969 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-15f3a8e7-2e7e-49db-9533-286825151783 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:35.208326 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-15f3a8e7-2e7e-49db-9533-286825151783 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:35.215764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-15f3a8e7-2e7e-49db-9533-286825151783 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.147715 Jun 23 10:51:35.217132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 141/268] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:35 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:36.234018 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3a149c04-5aba-4d47-be80-f860797750f1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:36.234667 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3a149c04-5aba-4d47-be80-f860797750f1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:36.241154 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3a149c04-5aba-4d47-be80-f860797750f1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:36.241601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3a149c04-5aba-4d47-be80-f860797750f1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:36.242394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3a149c04-5aba-4d47-be80-f860797750f1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:36.242830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3a149c04-5aba-4d47-be80-f860797750f1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:36.385283 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3a149c04-5aba-4d47-be80-f860797750f1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:36.393209 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3a149c04-5aba-4d47-be80-f860797750f1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.163666 Jun 23 10:51:36.393767 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 128/269] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:36 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:37.413430 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c3bb942e-4fa3-4f02-8dfa-e861e605bb30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:37.414410 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c3bb942e-4fa3-4f02-8dfa-e861e605bb30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:37.421857 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c3bb942e-4fa3-4f02-8dfa-e861e605bb30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:37.422213 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c3bb942e-4fa3-4f02-8dfa-e861e605bb30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:37.422999 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c3bb942e-4fa3-4f02-8dfa-e861e605bb30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:37.423429 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c3bb942e-4fa3-4f02-8dfa-e861e605bb30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:37.549523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c3bb942e-4fa3-4f02-8dfa-e861e605bb30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:37.556968 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c3bb942e-4fa3-4f02-8dfa-e861e605bb30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.149144 Jun 23 10:51:37.557523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 142/270] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:37 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:38.574301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d63aba38-1c89-4544-97e8-8e130cd69a91 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:38.574929 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d63aba38-1c89-4544-97e8-8e130cd69a91 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:38.582575 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d63aba38-1c89-4544-97e8-8e130cd69a91 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:38.583028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d63aba38-1c89-4544-97e8-8e130cd69a91 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:38.583897 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d63aba38-1c89-4544-97e8-8e130cd69a91 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:38.584339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d63aba38-1c89-4544-97e8-8e130cd69a91 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:38.717336 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d63aba38-1c89-4544-97e8-8e130cd69a91 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:38.724650 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d63aba38-1c89-4544-97e8-8e130cd69a91 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.154381 Jun 23 10:51:38.725193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 129/271] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:38 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:39.742390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5c04a006-00b1-42fc-9654-d5fbf4f24460 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:39.743000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5c04a006-00b1-42fc-9654-d5fbf4f24460 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:39.749795 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5c04a006-00b1-42fc-9654-d5fbf4f24460 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:39.750239 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5c04a006-00b1-42fc-9654-d5fbf4f24460 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:39.751046 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5c04a006-00b1-42fc-9654-d5fbf4f24460 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:39.751488 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5c04a006-00b1-42fc-9654-d5fbf4f24460 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:39.886647 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5c04a006-00b1-42fc-9654-d5fbf4f24460 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:39.894735 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5c04a006-00b1-42fc-9654-d5fbf4f24460 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.156186 Jun 23 10:51:39.895288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 143/272] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:39 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:40.912261 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-af03274b-afbc-4f2e-beff-99ce5486da7d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:40.913027 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-af03274b-afbc-4f2e-beff-99ce5486da7d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:40.920330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-af03274b-afbc-4f2e-beff-99ce5486da7d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:40.920769 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-af03274b-afbc-4f2e-beff-99ce5486da7d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:40.921519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-af03274b-afbc-4f2e-beff-99ce5486da7d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:40.921950 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-af03274b-afbc-4f2e-beff-99ce5486da7d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:41.051003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-af03274b-afbc-4f2e-beff-99ce5486da7d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:41.059336 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-af03274b-afbc-4f2e-beff-99ce5486da7d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.150818 Jun 23 10:51:41.059894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 130/273] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:40 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:42.076475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b9565e43-1478-4cab-9fa7-397ffc989f28 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:42.077065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b9565e43-1478-4cab-9fa7-397ffc989f28 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:42.083194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b9565e43-1478-4cab-9fa7-397ffc989f28 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:42.083632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b9565e43-1478-4cab-9fa7-397ffc989f28 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:42.084377 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b9565e43-1478-4cab-9fa7-397ffc989f28 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:42.084808 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b9565e43-1478-4cab-9fa7-397ffc989f28 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:42.214258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b9565e43-1478-4cab-9fa7-397ffc989f28 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:42.222866 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b9565e43-1478-4cab-9fa7-397ffc989f28 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.150426 Jun 23 10:51:42.223446 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 144/274] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:42 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:43.240124 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2cd268f8-a517-4506-81d8-716ff946a2ef tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:43.240658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2cd268f8-a517-4506-81d8-716ff946a2ef tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:43.247345 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2cd268f8-a517-4506-81d8-716ff946a2ef tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:43.247783 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2cd268f8-a517-4506-81d8-716ff946a2ef tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:43.248556 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2cd268f8-a517-4506-81d8-716ff946a2ef tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:43.248980 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2cd268f8-a517-4506-81d8-716ff946a2ef tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:43.381405 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2cd268f8-a517-4506-81d8-716ff946a2ef tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:43.388977 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2cd268f8-a517-4506-81d8-716ff946a2ef tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.152822 Jun 23 10:51:43.389728 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 131/275] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:43 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:44.404837 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-10273495-303b-4490-817e-3b48e834f9c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:44.406013 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-10273495-303b-4490-817e-3b48e834f9c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:44.412320 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10273495-303b-4490-817e-3b48e834f9c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:44.412765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10273495-303b-4490-817e-3b48e834f9c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:44.413523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10273495-303b-4490-817e-3b48e834f9c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:44.413949 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10273495-303b-4490-817e-3b48e834f9c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:44.547429 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-10273495-303b-4490-817e-3b48e834f9c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:44.555137 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-10273495-303b-4490-817e-3b48e834f9c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.154133 Jun 23 10:51:44.555704 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 145/276] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:44 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:45.572539 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-738186ca-de73-4d97-858b-bd759eed9d75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:45.573392 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-738186ca-de73-4d97-858b-bd759eed9d75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:45.580698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-738186ca-de73-4d97-858b-bd759eed9d75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:45.581140 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-738186ca-de73-4d97-858b-bd759eed9d75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:45.581887 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-738186ca-de73-4d97-858b-bd759eed9d75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:45.582331 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-738186ca-de73-4d97-858b-bd759eed9d75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:45.718832 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-738186ca-de73-4d97-858b-bd759eed9d75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:45.726176 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-738186ca-de73-4d97-858b-bd759eed9d75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.157506 Jun 23 10:51:45.726773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 132/277] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:45 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:46.743347 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8390400a-f91a-4321-9f7a-0842a85dd21f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:46.743993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8390400a-f91a-4321-9f7a-0842a85dd21f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:46.750424 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8390400a-f91a-4321-9f7a-0842a85dd21f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:46.750874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8390400a-f91a-4321-9f7a-0842a85dd21f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:46.751639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8390400a-f91a-4321-9f7a-0842a85dd21f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:46.752075 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8390400a-f91a-4321-9f7a-0842a85dd21f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:46.876155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8390400a-f91a-4321-9f7a-0842a85dd21f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:46.883513 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8390400a-f91a-4321-9f7a-0842a85dd21f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.143950 Jun 23 10:51:46.884070 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 146/278] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:46 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:47.900294 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8d615ede-a01e-4b9b-8e9e-6fea73f250a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:47.900902 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8d615ede-a01e-4b9b-8e9e-6fea73f250a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:47.907594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d615ede-a01e-4b9b-8e9e-6fea73f250a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:47.908040 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d615ede-a01e-4b9b-8e9e-6fea73f250a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:47.908793 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d615ede-a01e-4b9b-8e9e-6fea73f250a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:47.909224 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d615ede-a01e-4b9b-8e9e-6fea73f250a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:48.044390 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8d615ede-a01e-4b9b-8e9e-6fea73f250a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:48.052527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8d615ede-a01e-4b9b-8e9e-6fea73f250a4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.155934 Jun 23 10:51:48.053089 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 133/279] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:47 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:49.070294 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-19eff92c-2e41-4fb3-ae0b-bfacf2a87c75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:49.070929 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-19eff92c-2e41-4fb3-ae0b-bfacf2a87c75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:49.078137 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19eff92c-2e41-4fb3-ae0b-bfacf2a87c75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:49.078891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19eff92c-2e41-4fb3-ae0b-bfacf2a87c75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:49.079676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19eff92c-2e41-4fb3-ae0b-bfacf2a87c75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:49.080099 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19eff92c-2e41-4fb3-ae0b-bfacf2a87c75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:49.212908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-19eff92c-2e41-4fb3-ae0b-bfacf2a87c75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:49.221237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-19eff92c-2e41-4fb3-ae0b-bfacf2a87c75 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.154760 Jun 23 10:51:49.221803 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 147/280] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:49 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:50.239566 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c4a38e4c-b71a-4bcb-b4f4-4f816a8a4ba7 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:50.240177 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c4a38e4c-b71a-4bcb-b4f4-4f816a8a4ba7 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:50.246192 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c4a38e4c-b71a-4bcb-b4f4-4f816a8a4ba7 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:50.246698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c4a38e4c-b71a-4bcb-b4f4-4f816a8a4ba7 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:50.247471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c4a38e4c-b71a-4bcb-b4f4-4f816a8a4ba7 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:50.247905 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c4a38e4c-b71a-4bcb-b4f4-4f816a8a4ba7 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:50.250772 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:50.386358 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c4a38e4c-b71a-4bcb-b4f4-4f816a8a4ba7 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:50.394108 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c4a38e4c-b71a-4bcb-b4f4-4f816a8a4ba7 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.159701 Jun 23 10:51:50.394687 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 134/281] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:50 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:51.001424 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1043ddd1-1966-4130-863e-1fe928d6f2b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:51.001908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1043ddd1-1966-4130-863e-1fe928d6f2b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:51.007747 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1043ddd1-1966-4130-863e-1fe928d6f2b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:51.008189 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1043ddd1-1966-4130-863e-1fe928d6f2b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:51.008961 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1043ddd1-1966-4130-863e-1fe928d6f2b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:51.009385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1043ddd1-1966-4130-863e-1fe928d6f2b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:51.034127 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1043ddd1-1966-4130-863e-1fe928d6f2b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:51:51.119691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1043ddd1-1966-4130-863e-1fe928d6f2b0 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "DELETE /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 204 len: 0 microversion: 2.1 time: 0.121775 Jun 23 10:51:51.120659 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 148/282] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:51:50 2022] DELETE /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:51:51.129246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-62f5b6b2-d169-422e-88b0-cfd6b26b4599 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:51.129846 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-62f5b6b2-d169-422e-88b0-cfd6b26b4599 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:51.135826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-62f5b6b2-d169-422e-88b0-cfd6b26b4599 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:51.136266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-62f5b6b2-d169-422e-88b0-cfd6b26b4599 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:51.137007 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-62f5b6b2-d169-422e-88b0-cfd6b26b4599 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:51.137431 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-62f5b6b2-d169-422e-88b0-cfd6b26b4599 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:51.269998 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-62f5b6b2-d169-422e-88b0-cfd6b26b4599 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:51.278081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-62f5b6b2-d169-422e-88b0-cfd6b26b4599 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1554 microversion: 2.1 time: 0.153358 Jun 23 10:51:51.278706 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 135/283] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:51 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:51.412149 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-22f153f4-d794-457b-ab02-5fa28394b990 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:51.412987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-22f153f4-d794-457b-ab02-5fa28394b990 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:51.419061 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22f153f4-d794-457b-ab02-5fa28394b990 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:51.419513 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22f153f4-d794-457b-ab02-5fa28394b990 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:51.420342 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22f153f4-d794-457b-ab02-5fa28394b990 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:51.420690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22f153f4-d794-457b-ab02-5fa28394b990 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:51.697421 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-22f153f4-d794-457b-ab02-5fa28394b990 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:51.705817 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-22f153f4-d794-457b-ab02-5fa28394b990 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.299108 Jun 23 10:51:51.706384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 149/284] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:51 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:52.295955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3e50d59c-2406-4e4d-9f25-fe6920686866 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:52.296562 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3e50d59c-2406-4e4d-9f25-fe6920686866 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:52.303589 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3e50d59c-2406-4e4d-9f25-fe6920686866 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:52.304036 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3e50d59c-2406-4e4d-9f25-fe6920686866 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:52.304791 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3e50d59c-2406-4e4d-9f25-fe6920686866 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:52.305225 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3e50d59c-2406-4e4d-9f25-fe6920686866 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:52.436336 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3e50d59c-2406-4e4d-9f25-fe6920686866 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:52.444673 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3e50d59c-2406-4e4d-9f25-fe6920686866 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1554 microversion: 2.1 time: 0.152662 Jun 23 10:51:52.445235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 136/285] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:52 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:52.722400 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b7371cd4-43c0-4ec5-9783-1a7fc3cbeefc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:52.722993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b7371cd4-43c0-4ec5-9783-1a7fc3cbeefc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:52.729012 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b7371cd4-43c0-4ec5-9783-1a7fc3cbeefc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:52.729451 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b7371cd4-43c0-4ec5-9783-1a7fc3cbeefc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:52.730209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b7371cd4-43c0-4ec5-9783-1a7fc3cbeefc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:52.730675 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b7371cd4-43c0-4ec5-9783-1a7fc3cbeefc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:52.863299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b7371cd4-43c0-4ec5-9783-1a7fc3cbeefc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:52.871441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b7371cd4-43c0-4ec5-9783-1a7fc3cbeefc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.152807 Jun 23 10:51:52.881782 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 150/286] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:52 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:53.461545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ace6f756-c523-480d-a7f9-a30fea1c3793 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:53.462687 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ace6f756-c523-480d-a7f9-a30fea1c3793 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:53.469080 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ace6f756-c523-480d-a7f9-a30fea1c3793 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:53.469524 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ace6f756-c523-480d-a7f9-a30fea1c3793 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:53.471623 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ace6f756-c523-480d-a7f9-a30fea1c3793 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:53.472065 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ace6f756-c523-480d-a7f9-a30fea1c3793 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:53.625958 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ace6f756-c523-480d-a7f9-a30fea1c3793 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:53.634308 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ace6f756-c523-480d-a7f9-a30fea1c3793 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1554 microversion: 2.1 time: 0.176552 Jun 23 10:51:53.634890 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 137/287] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:53 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:53.888696 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4f998de7-5fc4-454e-b3b3-dce9775eb1a5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:53.889433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4f998de7-5fc4-454e-b3b3-dce9775eb1a5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:53.897743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4f998de7-5fc4-454e-b3b3-dce9775eb1a5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:53.898219 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4f998de7-5fc4-454e-b3b3-dce9775eb1a5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:53.899083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4f998de7-5fc4-454e-b3b3-dce9775eb1a5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:53.899619 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4f998de7-5fc4-454e-b3b3-dce9775eb1a5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:54.036416 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4f998de7-5fc4-454e-b3b3-dce9775eb1a5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:54.040303 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:54.046551 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4f998de7-5fc4-454e-b3b3-dce9775eb1a5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.161519 Jun 23 10:51:54.047122 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 151/288] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:53 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:54.652130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-999053ee-d954-49a6-944a-cbd46aeec50f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:54.652733 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-999053ee-d954-49a6-944a-cbd46aeec50f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:54.660029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-999053ee-d954-49a6-944a-cbd46aeec50f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:54.660411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-999053ee-d954-49a6-944a-cbd46aeec50f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:54.661166 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-999053ee-d954-49a6-944a-cbd46aeec50f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:54.661602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-999053ee-d954-49a6-944a-cbd46aeec50f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:54.793121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-999053ee-d954-49a6-944a-cbd46aeec50f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:54.801084 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-999053ee-d954-49a6-944a-cbd46aeec50f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1554 microversion: 2.1 time: 0.152704 Jun 23 10:51:54.801644 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 138/289] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:54 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:55.066045 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-47bfa535-1aee-46db-b6c6-823cee7e117f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:55.066677 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-47bfa535-1aee-46db-b6c6-823cee7e117f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:55.073940 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-47bfa535-1aee-46db-b6c6-823cee7e117f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:55.074495 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-47bfa535-1aee-46db-b6c6-823cee7e117f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:55.075263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-47bfa535-1aee-46db-b6c6-823cee7e117f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:55.075698 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-47bfa535-1aee-46db-b6c6-823cee7e117f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:55.203449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-47bfa535-1aee-46db-b6c6-823cee7e117f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:55.211102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-47bfa535-1aee-46db-b6c6-823cee7e117f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.150172 Jun 23 10:51:55.211657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 152/290] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:55 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:55.817140 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-73e483de-94fa-4327-a34e-3bf57bbf49d6 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:55.817745 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-73e483de-94fa-4327-a34e-3bf57bbf49d6 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:55.824465 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-73e483de-94fa-4327-a34e-3bf57bbf49d6 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:55.824907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-73e483de-94fa-4327-a34e-3bf57bbf49d6 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:55.825659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-73e483de-94fa-4327-a34e-3bf57bbf49d6 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:55.826089 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-73e483de-94fa-4327-a34e-3bf57bbf49d6 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:55.952762 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-73e483de-94fa-4327-a34e-3bf57bbf49d6 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:55.961339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-73e483de-94fa-4327-a34e-3bf57bbf49d6 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1554 microversion: 2.1 time: 0.148083 Jun 23 10:51:55.961903 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 139/291] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:55 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:56.228486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8987fab0-ece0-4ea0-b6f0-cac37cfa270d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:56.229080 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8987fab0-ece0-4ea0-b6f0-cac37cfa270d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:56.235240 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8987fab0-ece0-4ea0-b6f0-cac37cfa270d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:56.236256 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8987fab0-ece0-4ea0-b6f0-cac37cfa270d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:56.237101 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8987fab0-ece0-4ea0-b6f0-cac37cfa270d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:56.237532 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8987fab0-ece0-4ea0-b6f0-cac37cfa270d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:56.366864 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8987fab0-ece0-4ea0-b6f0-cac37cfa270d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:56.374206 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8987fab0-ece0-4ea0-b6f0-cac37cfa270d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.149621 Jun 23 10:51:56.374786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 153/292] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:56 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:56.978242 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-eaa9ea20-2c5b-4a3e-8992-8424bb948d7d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:56.978884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-eaa9ea20-2c5b-4a3e-8992-8424bb948d7d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:56.985339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eaa9ea20-2c5b-4a3e-8992-8424bb948d7d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:56.986035 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eaa9ea20-2c5b-4a3e-8992-8424bb948d7d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:56.986863 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eaa9ea20-2c5b-4a3e-8992-8424bb948d7d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:56.987297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eaa9ea20-2c5b-4a3e-8992-8424bb948d7d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:57.118412 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-eaa9ea20-2c5b-4a3e-8992-8424bb948d7d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:57.126221 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-eaa9ea20-2c5b-4a3e-8992-8424bb948d7d tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1554 microversion: 2.1 time: 0.151772 Jun 23 10:51:57.127537 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 140/293] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:56 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:57.392461 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fd2df050-ec48-4efd-b9d6-127c27e1a32c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:57.393065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fd2df050-ec48-4efd-b9d6-127c27e1a32c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:57.394920 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:57.400143 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fd2df050-ec48-4efd-b9d6-127c27e1a32c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:57.400578 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fd2df050-ec48-4efd-b9d6-127c27e1a32c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:57.401324 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fd2df050-ec48-4efd-b9d6-127c27e1a32c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:57.401750 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fd2df050-ec48-4efd-b9d6-127c27e1a32c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:57.531282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fd2df050-ec48-4efd-b9d6-127c27e1a32c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:57.539844 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fd2df050-ec48-4efd-b9d6-127c27e1a32c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.151385 Jun 23 10:51:57.540392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 154/294] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:57 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:58.144157 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c63eebbf-3382-480d-b32a-0e27d3eecbf5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:58.144753 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c63eebbf-3382-480d-b32a-0e27d3eecbf5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:58.151155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c63eebbf-3382-480d-b32a-0e27d3eecbf5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:58.151596 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c63eebbf-3382-480d-b32a-0e27d3eecbf5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:58.152351 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c63eebbf-3382-480d-b32a-0e27d3eecbf5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:58.152786 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c63eebbf-3382-480d-b32a-0e27d3eecbf5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:58.282828 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c63eebbf-3382-480d-b32a-0e27d3eecbf5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:58.290911 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c63eebbf-3382-480d-b32a-0e27d3eecbf5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1554 microversion: 2.1 time: 0.151114 Jun 23 10:51:58.291470 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 141/295] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:58 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:58.557301 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fe85ca90-3779-4910-a959-3db62c3f7c34 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:58.557904 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fe85ca90-3779-4910-a959-3db62c3f7c34 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:58.565066 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe85ca90-3779-4910-a959-3db62c3f7c34 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:58.565516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe85ca90-3779-4910-a959-3db62c3f7c34 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:58.566276 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe85ca90-3779-4910-a959-3db62c3f7c34 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:58.566735 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe85ca90-3779-4910-a959-3db62c3f7c34 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:58.706950 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fe85ca90-3779-4910-a959-3db62c3f7c34 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:58.714271 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fe85ca90-3779-4910-a959-3db62c3f7c34 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.160817 Jun 23 10:51:58.714879 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 155/296] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:58 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:59.308311 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-10c152ab-ce5f-43b0-928a-3939bd16aad4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:59.309648 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-10c152ab-ce5f-43b0-928a-3939bd16aad4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:59.312699 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=34 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:59.319978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-10c152ab-ce5f-43b0-928a-3939bd16aad4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:59.320646 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-10c152ab-ce5f-43b0-928a-3939bd16aad4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:59.321568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-10c152ab-ce5f-43b0-928a-3939bd16aad4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:59.322155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-10c152ab-ce5f-43b0-928a-3939bd16aad4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:59.456164 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-10c152ab-ce5f-43b0-928a-3939bd16aad4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:59.465449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-10c152ab-ce5f-43b0-928a-3939bd16aad4 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1554 microversion: 2.1 time: 0.160920 Jun 23 10:51:59.466100 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 142/297] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:59 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:51:59.731947 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6d5c12a5-818a-49e6-bb18-e3156ae78819 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:51:59.732856 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6d5c12a5-818a-49e6-bb18-e3156ae78819 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:51:59.739103 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d5c12a5-818a-49e6-bb18-e3156ae78819 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:59.739548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d5c12a5-818a-49e6-bb18-e3156ae78819 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:59.740316 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d5c12a5-818a-49e6-bb18-e3156ae78819 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:51:59.740748 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6d5c12a5-818a-49e6-bb18-e3156ae78819 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:51:59.884653 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6d5c12a5-818a-49e6-bb18-e3156ae78819 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:51:59.892892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6d5c12a5-818a-49e6-bb18-e3156ae78819 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.165132 Jun 23 10:51:59.893460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 156/298] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:51:59 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:00.482005 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0d924db9-99aa-45eb-9b36-834dfaffaa30 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:00.482763 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-0d924db9-99aa-45eb-9b36-834dfaffaa30 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:00.489194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0d924db9-99aa-45eb-9b36-834dfaffaa30 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:00.489727 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0d924db9-99aa-45eb-9b36-834dfaffaa30 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:00.491008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0d924db9-99aa-45eb-9b36-834dfaffaa30 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:00.491215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0d924db9-99aa-45eb-9b36-834dfaffaa30 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:00.638485 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-0d924db9-99aa-45eb-9b36-834dfaffaa30 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:00.648387 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0d924db9-99aa-45eb-9b36-834dfaffaa30 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1554 microversion: 2.1 time: 0.170319 Jun 23 10:52:00.659541 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 143/299] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:00 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:00.909487 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-14e6c92c-1091-41fc-b451-dd0dbb48ee53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:00.910171 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-14e6c92c-1091-41fc-b451-dd0dbb48ee53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:00.919877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14e6c92c-1091-41fc-b451-dd0dbb48ee53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:00.920330 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14e6c92c-1091-41fc-b451-dd0dbb48ee53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:00.921109 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14e6c92c-1091-41fc-b451-dd0dbb48ee53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:00.921543 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14e6c92c-1091-41fc-b451-dd0dbb48ee53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:01.079716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-14e6c92c-1091-41fc-b451-dd0dbb48ee53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:01.085073 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-98463060-73f6-42f6-a678-1770628dbdea req-c59c7024-75cc-4354-8cda-4c0579fd5da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737144bf-12fa-4bec-9855-65112e48ed69", "name": "network-vif-deleted", "tag": "595093b4-73b8-48ea-94e4-d0a5a594b1ff"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:52:01.090159 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-14e6c92c-1091-41fc-b451-dd0dbb48ee53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.185034 Jun 23 10:52:01.090842 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 157/300] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:00 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:01.107190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-98463060-73f6-42f6-a678-1770628dbdea req-c59c7024-75cc-4354-8cda-4c0579fd5da6 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:01.107716 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-98463060-73f6-42f6-a678-1770628dbdea req-c59c7024-75cc-4354-8cda-4c0579fd5da6 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:01.120532 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-98463060-73f6-42f6-a678-1770628dbdea req-c59c7024-75cc-4354-8cda-4c0579fd5da6 service nova] Creating event network-vif-deleted:595093b4-73b8-48ea-94e4-d0a5a594b1ff for instance 737144bf-12fa-4bec-9855-65112e48ed69 on hv-cinder-84614 Jun 23 10:52:01.127229 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-98463060-73f6-42f6-a678-1770628dbdea req-c59c7024-75cc-4354-8cda-4c0579fd5da6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047514 Jun 23 10:52:01.128134 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 144/301] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:52:01.666160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1912092f-da59-43d8-8e51-f97569754772 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:01.666786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1912092f-da59-43d8-8e51-f97569754772 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:01.673527 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1912092f-da59-43d8-8e51-f97569754772 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:01.674101 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1912092f-da59-43d8-8e51-f97569754772 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:01.675015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1912092f-da59-43d8-8e51-f97569754772 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:01.675445 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1912092f-da59-43d8-8e51-f97569754772 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:01.737955 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1912092f-da59-43d8-8e51-f97569754772 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:01.746011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1912092f-da59-43d8-8e51-f97569754772 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1346 microversion: 2.1 time: 0.083647 Jun 23 10:52:01.746599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 158/302] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:01 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:02.109102 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-acb613e3-4274-417b-97c0-e648834bc396 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:02.109780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-acb613e3-4274-417b-97c0-e648834bc396 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:02.115889 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-acb613e3-4274-417b-97c0-e648834bc396 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:02.116326 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-acb613e3-4274-417b-97c0-e648834bc396 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:02.117077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-acb613e3-4274-417b-97c0-e648834bc396 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:02.117506 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-acb613e3-4274-417b-97c0-e648834bc396 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:02.249596 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-acb613e3-4274-417b-97c0-e648834bc396 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:02.257944 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-acb613e3-4274-417b-97c0-e648834bc396 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.153617 Jun 23 10:52:02.258524 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 145/303] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:02 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:02.763083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-dc7da560-5f1a-4d92-a403-ccc16387f6de tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:02.763725 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-dc7da560-5f1a-4d92-a403-ccc16387f6de tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:02.769920 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc7da560-5f1a-4d92-a403-ccc16387f6de tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:02.770395 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc7da560-5f1a-4d92-a403-ccc16387f6de tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:02.771157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc7da560-5f1a-4d92-a403-ccc16387f6de tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:02.771592 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc7da560-5f1a-4d92-a403-ccc16387f6de tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:02.832322 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dc7da560-5f1a-4d92-a403-ccc16387f6de tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:02.840272 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-dc7da560-5f1a-4d92-a403-ccc16387f6de tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1346 microversion: 2.1 time: 0.081009 Jun 23 10:52:02.840822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 159/304] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:02 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:03.274859 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f86e6390-4ede-4599-8a45-552176a38cf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:03.275460 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f86e6390-4ede-4599-8a45-552176a38cf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:03.281786 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f86e6390-4ede-4599-8a45-552176a38cf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:03.282224 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f86e6390-4ede-4599-8a45-552176a38cf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:03.283070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f86e6390-4ede-4599-8a45-552176a38cf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:03.284031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f86e6390-4ede-4599-8a45-552176a38cf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:03.416306 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f86e6390-4ede-4599-8a45-552176a38cf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:03.425264 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f86e6390-4ede-4599-8a45-552176a38cf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.154080 Jun 23 10:52:03.426286 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 146/305] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:03 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:03.857485 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0f7a215c-9d27-4628-8519-c3203332cebf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:03.858093 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0f7a215c-9d27-4628-8519-c3203332cebf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:03.864600 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f7a215c-9d27-4628-8519-c3203332cebf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:03.865183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f7a215c-9d27-4628-8519-c3203332cebf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:03.865950 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f7a215c-9d27-4628-8519-c3203332cebf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:03.866412 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f7a215c-9d27-4628-8519-c3203332cebf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:03.926489 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0f7a215c-9d27-4628-8519-c3203332cebf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:03.934173 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0f7a215c-9d27-4628-8519-c3203332cebf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1346 microversion: 2.1 time: 0.080481 Jun 23 10:52:03.934749 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 160/306] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:03 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:04.443297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6d6aad0b-e9d2-4f26-a6bd-109121818072 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:04.443936 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6d6aad0b-e9d2-4f26-a6bd-109121818072 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:04.450558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d6aad0b-e9d2-4f26-a6bd-109121818072 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:04.451016 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d6aad0b-e9d2-4f26-a6bd-109121818072 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:04.451777 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d6aad0b-e9d2-4f26-a6bd-109121818072 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:04.452296 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d6aad0b-e9d2-4f26-a6bd-109121818072 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:04.580529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6d6aad0b-e9d2-4f26-a6bd-109121818072 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:04.587792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6d6aad0b-e9d2-4f26-a6bd-109121818072 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.148931 Jun 23 10:52:04.588335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 147/307] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:04 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:04.951606 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-84080ded-38f9-4a5d-89fa-d3d7a980fa46 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:04.952212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-84080ded-38f9-4a5d-89fa-d3d7a980fa46 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:04.958866 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84080ded-38f9-4a5d-89fa-d3d7a980fa46 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:04.959313 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84080ded-38f9-4a5d-89fa-d3d7a980fa46 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:04.960066 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84080ded-38f9-4a5d-89fa-d3d7a980fa46 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:04.960496 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84080ded-38f9-4a5d-89fa-d3d7a980fa46 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:05.019703 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-84080ded-38f9-4a5d-89fa-d3d7a980fa46 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:05.027539 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-84080ded-38f9-4a5d-89fa-d3d7a980fa46 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1346 microversion: 2.1 time: 0.079967 Jun 23 10:52:05.028087 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 161/308] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:04 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:05.604611 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6d86f758-f287-46b0-a498-6c9df57e44d0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:05.605218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6d86f758-f287-46b0-a498-6c9df57e44d0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:05.612029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d86f758-f287-46b0-a498-6c9df57e44d0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:05.612475 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d86f758-f287-46b0-a498-6c9df57e44d0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:05.613232 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d86f758-f287-46b0-a498-6c9df57e44d0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:05.613669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6d86f758-f287-46b0-a498-6c9df57e44d0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:05.741113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6d86f758-f287-46b0-a498-6c9df57e44d0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:05.748420 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6d86f758-f287-46b0-a498-6c9df57e44d0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.147596 Jun 23 10:52:05.748976 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 148/309] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:05 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:06.044167 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-656cc9d9-efb6-424b-9bdf-0e39529909b5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:06.044703 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-656cc9d9-efb6-424b-9bdf-0e39529909b5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:06.051432 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-656cc9d9-efb6-424b-9bdf-0e39529909b5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:06.051876 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-656cc9d9-efb6-424b-9bdf-0e39529909b5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:06.052635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-656cc9d9-efb6-424b-9bdf-0e39529909b5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:06.053065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-656cc9d9-efb6-424b-9bdf-0e39529909b5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:06.113121 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-656cc9d9-efb6-424b-9bdf-0e39529909b5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:06.121184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-656cc9d9-efb6-424b-9bdf-0e39529909b5 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1346 microversion: 2.1 time: 0.080960 Jun 23 10:52:06.121734 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 162/310] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:06 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:06.765980 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-52c6f7de-1051-4f7f-b1c5-367aaebc3be6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:06.766531 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-52c6f7de-1051-4f7f-b1c5-367aaebc3be6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:06.773848 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-52c6f7de-1051-4f7f-b1c5-367aaebc3be6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:06.774284 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-52c6f7de-1051-4f7f-b1c5-367aaebc3be6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:06.775063 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-52c6f7de-1051-4f7f-b1c5-367aaebc3be6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:06.775486 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-52c6f7de-1051-4f7f-b1c5-367aaebc3be6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:06.904072 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-52c6f7de-1051-4f7f-b1c5-367aaebc3be6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:06.913330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-52c6f7de-1051-4f7f-b1c5-367aaebc3be6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.151275 Jun 23 10:52:06.913874 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 149/311] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:06 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:07.138437 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-22dabac9-6707-4a96-b743-8b08b00fd2d2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:07.139039 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-22dabac9-6707-4a96-b743-8b08b00fd2d2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:07.146209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22dabac9-6707-4a96-b743-8b08b00fd2d2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:07.146792 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22dabac9-6707-4a96-b743-8b08b00fd2d2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:07.147539 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22dabac9-6707-4a96-b743-8b08b00fd2d2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:07.147968 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22dabac9-6707-4a96-b743-8b08b00fd2d2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:07.209944 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-22dabac9-6707-4a96-b743-8b08b00fd2d2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:07.217863 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-22dabac9-6707-4a96-b743-8b08b00fd2d2 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1346 microversion: 2.1 time: 0.083278 Jun 23 10:52:07.218422 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 163/312] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:07 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:07.930873 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ce572218-7d0d-4ff5-8d7d-36ea54d21a05 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:07.931618 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ce572218-7d0d-4ff5-8d7d-36ea54d21a05 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:07.938137 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ce572218-7d0d-4ff5-8d7d-36ea54d21a05 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:07.938670 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ce572218-7d0d-4ff5-8d7d-36ea54d21a05 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:07.939543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ce572218-7d0d-4ff5-8d7d-36ea54d21a05 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:07.939984 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ce572218-7d0d-4ff5-8d7d-36ea54d21a05 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:08.069425 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ce572218-7d0d-4ff5-8d7d-36ea54d21a05 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:08.078829 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ce572218-7d0d-4ff5-8d7d-36ea54d21a05 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.151866 Jun 23 10:52:08.079787 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 150/313] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:07 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:08.234211 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5074f289-fe9c-4079-943f-56efa298346f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:08.234928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5074f289-fe9c-4079-943f-56efa298346f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:08.241196 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5074f289-fe9c-4079-943f-56efa298346f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:08.241640 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5074f289-fe9c-4079-943f-56efa298346f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:08.242468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5074f289-fe9c-4079-943f-56efa298346f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:08.242901 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5074f289-fe9c-4079-943f-56efa298346f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:08.316709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5074f289-fe9c-4079-943f-56efa298346f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:08.324772 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5074f289-fe9c-4079-943f-56efa298346f tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1346 microversion: 2.1 time: 0.094368 Jun 23 10:52:08.325324 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 164/314] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:08 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:09.096988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-82388f8e-b117-4d37-992e-9d975cc65793 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:09.097707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-82388f8e-b117-4d37-992e-9d975cc65793 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:09.104925 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82388f8e-b117-4d37-992e-9d975cc65793 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:09.105360 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82388f8e-b117-4d37-992e-9d975cc65793 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:09.106114 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82388f8e-b117-4d37-992e-9d975cc65793 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:09.106575 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82388f8e-b117-4d37-992e-9d975cc65793 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:09.121970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:09.246362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-82388f8e-b117-4d37-992e-9d975cc65793 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:09.253963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-82388f8e-b117-4d37-992e-9d975cc65793 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.161608 Jun 23 10:52:09.254636 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 151/315] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:09 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:09.343557 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:09.344172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:09.350985 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:09.351481 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:09.352237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:09.352671 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:09.382837 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:09.383277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:09.383719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lazy-loading 'fault' on Instance uuid 737144bf-12fa-4bec-9855-65112e48ed69 {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:52:09.427449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b982efb5297246ccbf6515cf7bc9dde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d176a6ae64d38905e5bd43c97c253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:09.435306 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6ddd80c1-0368-4b1c-a2e9-a74b0f358853 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 200 len: 1351 microversion: 2.1 time: 0.095587 Jun 23 10:52:09.435841 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 165/316] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:09 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:10.271111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4de7224d-296f-4b9a-82e9-7a2c1d247f3c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:10.271722 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4de7224d-296f-4b9a-82e9-7a2c1d247f3c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:10.278076 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4de7224d-296f-4b9a-82e9-7a2c1d247f3c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:10.278554 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4de7224d-296f-4b9a-82e9-7a2c1d247f3c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:10.279304 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4de7224d-296f-4b9a-82e9-7a2c1d247f3c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:10.279737 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4de7224d-296f-4b9a-82e9-7a2c1d247f3c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:10.413812 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4de7224d-296f-4b9a-82e9-7a2c1d247f3c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:10.421227 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4de7224d-296f-4b9a-82e9-7a2c1d247f3c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.154526 Jun 23 10:52:10.421781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 152/317] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:10 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:10.452436 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:10.453088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:10.460119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:10.460564 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:10.461348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:10.461774 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:10.476297 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] HTTP exception thrown: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Request method failure captured: Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 HTTP/1.1 Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgKjvaTwMoqAUocgmzmccCTq61oHawwret7qeaZStMqa5ko1YpkRrOJBcx06dUskm7W1GvUVQByufQxtF2cAxRDAK_yxI6Lq49gRaPb2LuH8iCyH6XUs01PMdmsyr8fWM5DMLpMw_TwF2S_uF6sdLnm63VMKe8othZeCNICqOKbJs Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: b14d176a6ae64d38905e5bd43c97c253 Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:52:10.481393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b14d176a6ae64d38905e5bd43c97c253", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: b14d176a6ae64d38905e5bd43c97c253 Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-DeleteServersTestJSON-1226892068-project Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: b982efb5297246ccbf6515cf7bc9dde5 Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-DeleteServersTestJSON-1226892068-project Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.482962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '737144bf-12fa-4bec-9855-65112e48ed69'} Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:52:10.484028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.485670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.487494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Returning 404 to user: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:52:10.487494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4c387eed-0706-4ed0-adcb-d63c07456dbf tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 404 len: 111 microversion: 2.1 time: 0.034838 Jun 23 10:52:10.487494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 166/318] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:10 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:52:10.600656 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:10.601622 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:10.607829 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:10.608364 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:10.609170 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:10.609658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:10.624892 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] HTTP exception thrown: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Request method failure captured: Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69/os-volume_attachments HTTP/1.1 Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgKjvaTwMoqAUocgmzmccCTq61oHawwret7qeaZStMqa5ko1YpkRrOJBcx06dUskm7W1GvUVQByufQxtF2cAxRDAK_yxI6Lq49gRaPb2LuH8iCyH6XUs01PMdmsyr8fWM5DMLpMw_TwF2S_uF6sdLnm63VMKe8othZeCNICqOKbJs Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: b14d176a6ae64d38905e5bd43c97c253 Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:52:10.629050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b14d176a6ae64d38905e5bd43c97c253", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: b14d176a6ae64d38905e5bd43c97c253 Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-DeleteServersTestJSON-1226892068-project Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: b982efb5297246ccbf6515cf7bc9dde5 Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-DeleteServersTestJSON-1226892068-project Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.630271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'server_id': '737144bf-12fa-4bec-9855-65112e48ed69'} Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:52:10.631022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:10.632069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:10.633126 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Returning 404 to user: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:52:10.633126 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1b310590-a01c-4925-9df3-f856fb18f53a tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034626 Jun 23 10:52:10.633126 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 153/319] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:52:10 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:52:11.438522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d6dfa59e-cd23-4135-9eaf-45c746fd7ba1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:11.439234 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d6dfa59e-cd23-4135-9eaf-45c746fd7ba1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:11.446480 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d6dfa59e-cd23-4135-9eaf-45c746fd7ba1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:11.446933 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d6dfa59e-cd23-4135-9eaf-45c746fd7ba1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:11.447702 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d6dfa59e-cd23-4135-9eaf-45c746fd7ba1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:11.448400 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d6dfa59e-cd23-4135-9eaf-45c746fd7ba1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:11.582531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d6dfa59e-cd23-4135-9eaf-45c746fd7ba1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:11.590072 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d6dfa59e-cd23-4135-9eaf-45c746fd7ba1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.155362 Jun 23 10:52:11.590732 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 167/320] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:11 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:11.888344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:11.888857 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:11.896119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:11.896738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:11.898394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:11.898774 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:11.915003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] HTTP exception thrown: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Request method failure captured: Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 HTTP/1.1 Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgKjvaTwMoqAUocgmzmccCTq61oHawwret7qeaZStMqa5ko1YpkRrOJBcx06dUskm7W1GvUVQByufQxtF2cAxRDAK_yxI6Lq49gRaPb2LuH8iCyH6XUs01PMdmsyr8fWM5DMLpMw_TwF2S_uF6sdLnm63VMKe8othZeCNICqOKbJs Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: b14d176a6ae64d38905e5bd43c97c253 Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:52:11.917077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b14d176a6ae64d38905e5bd43c97c253", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: b14d176a6ae64d38905e5bd43c97c253 Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-DeleteServersTestJSON-1226892068-project Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: b982efb5297246ccbf6515cf7bc9dde5 Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-DeleteServersTestJSON-1226892068-project Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.918555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '737144bf-12fa-4bec-9855-65112e48ed69'} Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:52:11.919519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.920748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.922132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Returning 404 to user: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:52:11.922132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-66bf1322-9eb0-42d5-a93d-fac38879e3b9 tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "DELETE /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 404 len: 111 microversion: 2.1 time: 0.034521 Jun 23 10:52:11.922132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 154/321] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:52:11 2022] DELETE /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:52:11.928485 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:11.929087 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] [instance: 737144bf-12fa-4bec-9855-65112e48ed69] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:11.935618 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:11.936105 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:11.937159 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:11.937789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:11.959064 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] HTTP exception thrown: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Request method failure captured: Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 HTTP/1.1 Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgKjvaTwMoqAUocgmzmccCTq61oHawwret7qeaZStMqa5ko1YpkRrOJBcx06dUskm7W1GvUVQByufQxtF2cAxRDAK_yxI6Lq49gRaPb2LuH8iCyH6XUs01PMdmsyr8fWM5DMLpMw_TwF2S_uF6sdLnm63VMKe8othZeCNICqOKbJs Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: b14d176a6ae64d38905e5bd43c97c253 Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:52:11.960813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b14d176a6ae64d38905e5bd43c97c253", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b14d176a6ae64d38905e5bd43c97c253"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: b14d176a6ae64d38905e5bd43c97c253 Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226892068 Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-DeleteServersTestJSON-1226892068-project Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: b982efb5297246ccbf6515cf7bc9dde5 Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-DeleteServersTestJSON-1226892068-project Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.962364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '737144bf-12fa-4bec-9855-65112e48ed69'} Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:52:11.963263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. Jun 23 10:52:11.964516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:52:11.965757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] Returning 404 to user: Instance 737144bf-12fa-4bec-9855-65112e48ed69 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:52:11.965757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1dfc89ac-8e11-4b1c-9acc-87a42163819e tempest-DeleteServersTestJSON-1226892068 tempest-DeleteServersTestJSON-1226892068-project] 10.222.0.39 "GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69" status: 404 len: 111 microversion: 2.1 time: 0.039393 Jun 23 10:52:11.967140 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 168/322] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:11 2022] GET /compute/v2.1/servers/737144bf-12fa-4bec-9855-65112e48ed69 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:52:12.607529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ec0b2368-d2f3-442b-9637-b32d18f1d217 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:12.608410 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ec0b2368-d2f3-442b-9637-b32d18f1d217 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:12.615596 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ec0b2368-d2f3-442b-9637-b32d18f1d217 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:12.616228 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ec0b2368-d2f3-442b-9637-b32d18f1d217 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:12.617155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ec0b2368-d2f3-442b-9637-b32d18f1d217 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:12.617745 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ec0b2368-d2f3-442b-9637-b32d18f1d217 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:13.154843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ec0b2368-d2f3-442b-9637-b32d18f1d217 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:13.167256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ec0b2368-d2f3-442b-9637-b32d18f1d217 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.562944 Jun 23 10:52:13.168061 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 155/323] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:12 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:14.185402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-805764ae-6f0f-4290-92cc-5dcf76d782e6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:14.186787 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-805764ae-6f0f-4290-92cc-5dcf76d782e6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:14.200388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-805764ae-6f0f-4290-92cc-5dcf76d782e6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:14.201645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-805764ae-6f0f-4290-92cc-5dcf76d782e6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:14.202805 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-805764ae-6f0f-4290-92cc-5dcf76d782e6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:14.206052 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-805764ae-6f0f-4290-92cc-5dcf76d782e6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:14.271201 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:14.499677 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-805764ae-6f0f-4290-92cc-5dcf76d782e6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:14.507667 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-805764ae-6f0f-4290-92cc-5dcf76d782e6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.327051 Jun 23 10:52:14.511828 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 169/324] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:14 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:15.527965 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a0700335-ae67-40e8-a634-d7daeff69904 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:15.529273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a0700335-ae67-40e8-a634-d7daeff69904 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:15.546142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a0700335-ae67-40e8-a634-d7daeff69904 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:15.553832 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a0700335-ae67-40e8-a634-d7daeff69904 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:15.556134 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a0700335-ae67-40e8-a634-d7daeff69904 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:15.557210 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a0700335-ae67-40e8-a634-d7daeff69904 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:16.154131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a0700335-ae67-40e8-a634-d7daeff69904 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:16.163421 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a0700335-ae67-40e8-a634-d7daeff69904 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.639136 Jun 23 10:52:16.170531 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 156/325] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:15 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:17.183803 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1e9aef97-9966-409f-bde9-b51359f9e86f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:17.185283 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1e9aef97-9966-409f-bde9-b51359f9e86f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:17.199376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1e9aef97-9966-409f-bde9-b51359f9e86f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:17.200249 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1e9aef97-9966-409f-bde9-b51359f9e86f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:17.201287 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1e9aef97-9966-409f-bde9-b51359f9e86f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:17.202533 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1e9aef97-9966-409f-bde9-b51359f9e86f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:17.401437 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1e9aef97-9966-409f-bde9-b51359f9e86f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:17.411132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1e9aef97-9966-409f-bde9-b51359f9e86f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.233648 Jun 23 10:52:17.412338 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 170/326] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:17 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:18.429039 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f4782377-c881-4c76-85d6-3d2d7e3e10e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:18.430560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f4782377-c881-4c76-85d6-3d2d7e3e10e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:18.438311 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f4782377-c881-4c76-85d6-3d2d7e3e10e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:18.439088 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f4782377-c881-4c76-85d6-3d2d7e3e10e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:18.440558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f4782377-c881-4c76-85d6-3d2d7e3e10e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:18.441193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f4782377-c881-4c76-85d6-3d2d7e3e10e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:18.636075 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f4782377-c881-4c76-85d6-3d2d7e3e10e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:18.647952 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f4782377-c881-4c76-85d6-3d2d7e3e10e5 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1522 microversion: 2.1 time: 0.223010 Jun 23 10:52:18.651561 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 157/327] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:18 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:19.668393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a502977b-06b3-4be8-b91e-dd5504ac169e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:19.670037 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a502977b-06b3-4be8-b91e-dd5504ac169e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:19.689356 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a502977b-06b3-4be8-b91e-dd5504ac169e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:19.691778 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a502977b-06b3-4be8-b91e-dd5504ac169e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:19.693185 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a502977b-06b3-4be8-b91e-dd5504ac169e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:19.695883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a502977b-06b3-4be8-b91e-dd5504ac169e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:19.887372 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a502977b-06b3-4be8-b91e-dd5504ac169e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:19.897464 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a502977b-06b3-4be8-b91e-dd5504ac169e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1502 microversion: 2.1 time: 0.233191 Jun 23 10:52:19.910343 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 171/328] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:19 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:19.927326 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-dca1956f-f163-4334-bc25-91dbfe65c7a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:19.928504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-dca1956f-f163-4334-bc25-91dbfe65c7a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:19.936384 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dca1956f-f163-4334-bc25-91dbfe65c7a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:19.936920 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dca1956f-f163-4334-bc25-91dbfe65c7a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:19.937780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dca1956f-f163-4334-bc25-91dbfe65c7a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:19.938269 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dca1956f-f163-4334-bc25-91dbfe65c7a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:20.394122 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-dca1956f-f163-4334-bc25-91dbfe65c7a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:20.406887 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-dca1956f-f163-4334-bc25-91dbfe65c7a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1515 microversion: 2.1 time: 0.490627 Jun 23 10:52:20.409129 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 158/329] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:19 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1515 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:25.342007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-deb563e5-225f-46fc-a8ee-0bff11578c27 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:52:25.344626 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-deb563e5-225f-46fc-a8ee-0bff11578c27 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:25.356919 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-deb563e5-225f-46fc-a8ee-0bff11578c27 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:25.357893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-deb563e5-225f-46fc-a8ee-0bff11578c27 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:25.359316 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-deb563e5-225f-46fc-a8ee-0bff11578c27 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:25.359929 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-deb563e5-225f-46fc-a8ee-0bff11578c27 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:25.391505 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-deb563e5-225f-46fc-a8ee-0bff11578c27 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lazy-loading 'flavor' on Instance uuid bdecdfe5-d298-4823-a396-cf390e769f92 {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:52:25.522420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-deb563e5-225f-46fc-a8ee-0bff11578c27 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92/action" status: 200 len: 32 microversion: 2.1 time: 0.178576 Jun 23 10:52:25.525094 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 172/330] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:52:25 2022] POST /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 10:52:25.540599 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3acc9fd0-7db0-4f12-ad9d-360c2a2a401a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:25.541411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3acc9fd0-7db0-4f12-ad9d-360c2a2a401a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:25.554253 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3acc9fd0-7db0-4f12-ad9d-360c2a2a401a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:25.555034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3acc9fd0-7db0-4f12-ad9d-360c2a2a401a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:25.556033 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3acc9fd0-7db0-4f12-ad9d-360c2a2a401a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:25.556559 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3acc9fd0-7db0-4f12-ad9d-360c2a2a401a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:25.819184 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3acc9fd0-7db0-4f12-ad9d-360c2a2a401a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:25.836041 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3acc9fd0-7db0-4f12-ad9d-360c2a2a401a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.303616 Jun 23 10:52:25.844401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 159/331] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:25 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:26.861061 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-028a3eeb-6f2c-4d76-9685-2898604a851b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:26.862893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-028a3eeb-6f2c-4d76-9685-2898604a851b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:26.880335 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-028a3eeb-6f2c-4d76-9685-2898604a851b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:26.884923 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-028a3eeb-6f2c-4d76-9685-2898604a851b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:26.887683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-028a3eeb-6f2c-4d76-9685-2898604a851b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:26.889746 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-028a3eeb-6f2c-4d76-9685-2898604a851b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:27.255794 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-028a3eeb-6f2c-4d76-9685-2898604a851b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:27.270637 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-028a3eeb-6f2c-4d76-9685-2898604a851b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.413363 Jun 23 10:52:27.271237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 173/332] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:26 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:28.290887 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-77cb7a10-8522-4dc4-969c-68cbfad2a9b6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:28.292221 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-77cb7a10-8522-4dc4-969c-68cbfad2a9b6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:28.305705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-77cb7a10-8522-4dc4-969c-68cbfad2a9b6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:28.306169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-77cb7a10-8522-4dc4-969c-68cbfad2a9b6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:28.312901 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-77cb7a10-8522-4dc4-969c-68cbfad2a9b6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:28.316111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-77cb7a10-8522-4dc4-969c-68cbfad2a9b6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:28.889591 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-77cb7a10-8522-4dc4-969c-68cbfad2a9b6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:28.907726 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-77cb7a10-8522-4dc4-969c-68cbfad2a9b6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.623143 Jun 23 10:52:28.919273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 160/333] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:28 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:29.933781 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-54263708-fca7-43ed-bb9a-cb663fb3ddc8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:29.935341 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-54263708-fca7-43ed-bb9a-cb663fb3ddc8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:29.945741 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=42 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:29.950408 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-54263708-fca7-43ed-bb9a-cb663fb3ddc8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:29.953002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-54263708-fca7-43ed-bb9a-cb663fb3ddc8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:29.958747 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-54263708-fca7-43ed-bb9a-cb663fb3ddc8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:29.960963 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-54263708-fca7-43ed-bb9a-cb663fb3ddc8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:30.324427 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-54263708-fca7-43ed-bb9a-cb663fb3ddc8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:30.334776 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-54263708-fca7-43ed-bb9a-cb663fb3ddc8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.406269 Jun 23 10:52:30.336624 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 174/334] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:29 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:31.353409 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-220884b8-5ff7-48a2-a15a-ec5e5eeb72e1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:31.354243 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-220884b8-5ff7-48a2-a15a-ec5e5eeb72e1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:31.356490 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=38 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:31.367324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-220884b8-5ff7-48a2-a15a-ec5e5eeb72e1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:31.367869 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-220884b8-5ff7-48a2-a15a-ec5e5eeb72e1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:31.368869 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-220884b8-5ff7-48a2-a15a-ec5e5eeb72e1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:31.369380 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-220884b8-5ff7-48a2-a15a-ec5e5eeb72e1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:31.984529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-220884b8-5ff7-48a2-a15a-ec5e5eeb72e1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:31.996311 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-220884b8-5ff7-48a2-a15a-ec5e5eeb72e1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.646718 Jun 23 10:52:32.008319 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 161/335] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:31 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:33.013765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-668c8819-c855-4c5d-aa3d-cd45f1097a78 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:33.013765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-668c8819-c855-4c5d-aa3d-cd45f1097a78 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:33.022075 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-668c8819-c855-4c5d-aa3d-cd45f1097a78 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:33.025808 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-668c8819-c855-4c5d-aa3d-cd45f1097a78 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:33.027609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-668c8819-c855-4c5d-aa3d-cd45f1097a78 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:33.028722 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-668c8819-c855-4c5d-aa3d-cd45f1097a78 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:33.256124 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-668c8819-c855-4c5d-aa3d-cd45f1097a78 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:33.265146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-668c8819-c855-4c5d-aa3d-cd45f1097a78 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.255957 Jun 23 10:52:33.275977 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 175/336] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:33 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:34.284142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2d369a6a-7d66-4d54-a7d5-212e0523153f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:34.285426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2d369a6a-7d66-4d54-a7d5-212e0523153f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:34.296983 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d369a6a-7d66-4d54-a7d5-212e0523153f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:34.297757 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d369a6a-7d66-4d54-a7d5-212e0523153f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:34.307741 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d369a6a-7d66-4d54-a7d5-212e0523153f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:34.308401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d369a6a-7d66-4d54-a7d5-212e0523153f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:34.475760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2d369a6a-7d66-4d54-a7d5-212e0523153f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:34.484807 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2d369a6a-7d66-4d54-a7d5-212e0523153f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.205307 Jun 23 10:52:34.490363 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 162/337] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:34 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:35.503397 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2d143f80-857e-4c8e-b00b-6660508d1cfe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:35.504602 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2d143f80-857e-4c8e-b00b-6660508d1cfe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:35.514219 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d143f80-857e-4c8e-b00b-6660508d1cfe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:35.514717 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d143f80-857e-4c8e-b00b-6660508d1cfe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:35.515484 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d143f80-857e-4c8e-b00b-6660508d1cfe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:35.515913 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d143f80-857e-4c8e-b00b-6660508d1cfe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:35.858714 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2d143f80-857e-4c8e-b00b-6660508d1cfe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:35.867740 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2d143f80-857e-4c8e-b00b-6660508d1cfe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.370081 Jun 23 10:52:35.868339 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 176/338] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:35 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:36.886769 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5dbdd56a-4783-4146-b8a4-bc3d9b4e12d9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:36.888533 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5dbdd56a-4783-4146-b8a4-bc3d9b4e12d9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:36.897301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dbdd56a-4783-4146-b8a4-bc3d9b4e12d9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:36.897749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dbdd56a-4783-4146-b8a4-bc3d9b4e12d9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:36.898547 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dbdd56a-4783-4146-b8a4-bc3d9b4e12d9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:36.899078 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dbdd56a-4783-4146-b8a4-bc3d9b4e12d9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:37.057240 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5dbdd56a-4783-4146-b8a4-bc3d9b4e12d9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:37.074401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5dbdd56a-4783-4146-b8a4-bc3d9b4e12d9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.191979 Jun 23 10:52:37.075067 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 163/339] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:36 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:38.091888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8d19f6e6-e5e8-498b-975c-7d63053d6077 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:38.093287 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8d19f6e6-e5e8-498b-975c-7d63053d6077 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:38.101858 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8d19f6e6-e5e8-498b-975c-7d63053d6077 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:38.102311 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8d19f6e6-e5e8-498b-975c-7d63053d6077 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:38.103110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8d19f6e6-e5e8-498b-975c-7d63053d6077 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:38.103546 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8d19f6e6-e5e8-498b-975c-7d63053d6077 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:38.302237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8d19f6e6-e5e8-498b-975c-7d63053d6077 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:38.312622 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8d19f6e6-e5e8-498b-975c-7d63053d6077 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.224489 Jun 23 10:52:38.313765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 177/340] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:38 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:39.329283 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7f9e86b8-32c6-4bbc-98a2-47c84800fc12 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:39.330625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7f9e86b8-32c6-4bbc-98a2-47c84800fc12 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:39.345053 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f9e86b8-32c6-4bbc-98a2-47c84800fc12 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:39.346443 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f9e86b8-32c6-4bbc-98a2-47c84800fc12 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:39.347583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f9e86b8-32c6-4bbc-98a2-47c84800fc12 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:39.348235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f9e86b8-32c6-4bbc-98a2-47c84800fc12 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:39.400095 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=68 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:39.593072 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7f9e86b8-32c6-4bbc-98a2-47c84800fc12 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:39.602525 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7f9e86b8-32c6-4bbc-98a2-47c84800fc12 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.277116 Jun 23 10:52:39.613379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 164/341] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:39 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:40.001059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9d38db1c-1d67-412d-aff7-1d1dc24603cc tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Action: 'create', calling method: .version_select at 0x7f8dc946df70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-725333457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKouM+/PKg5NztdgazTWdfyvhP5ekDQYUWWm1vx5QTeNXrD+U8U8qsxUpWj4zcGul/nmCAi3eHzNDqJI4dQSpA6gzs6vZX0icSprfWhMyzn0GVfv5HOxx3ejDVDU9txbRQ=="}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:52:40.016026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-9d38db1c-1d67-412d-aff7-1d1dc24603cc tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Getting quotas for project 9024c2d0554a4270bbc9222800e9dcb6. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:52:40.020000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-9d38db1c-1d67-412d-aff7-1d1dc24603cc tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Getting quotas for user 6dbb7fcbd9604a87a8b4dd380ca9cd56 and project 9024c2d0554a4270bbc9222800e9dcb6. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:52:40.041644 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9d38db1c-1d67-412d-aff7-1d1dc24603cc tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044560 Jun 23 10:52:40.042358 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 178/342] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 10:52:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:52:40.158075 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1892213524", "imageRef": "d6d25799-3499-46ce-b9d5-216ddfe57a4f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-725333457", "networks": [{"uuid": "958b349b-6e45-4b5a-a77e-fd6d25c6995f"}]}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:52:40.226591 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] validate_networks() for [('958b349b-6e45-4b5a-a77e-fd6d25c6995f', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:52:40.622370 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2d784d33-59c7-48f8-b2a4-a6f8a514c91b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:40.623483 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2d784d33-59c7-48f8-b2a4-a6f8a514c91b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:40.635116 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d784d33-59c7-48f8-b2a4-a6f8a514c91b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:40.636187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d784d33-59c7-48f8-b2a4-a6f8a514c91b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:40.637466 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d784d33-59c7-48f8-b2a4-a6f8a514c91b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:40.638120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d784d33-59c7-48f8-b2a4-a6f8a514c91b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:40.668059 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:52:40.668542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:52:40.669064 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:52:40.669530 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:52:40.670061 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:52:40.681785 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:40.683260 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:40.684740 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:40.685476 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:40.703394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Getting quotas for project 9024c2d0554a4270bbc9222800e9dcb6. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:52:40.708424 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Getting quotas for user 6dbb7fcbd9604a87a8b4dd380ca9cd56 and project 9024c2d0554a4270bbc9222800e9dcb6. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:52:40.728676 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:52:40.731251 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6d25799-3499-46ce-b9d5-216ddfe57a4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:52:40.812689 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-adad0d17-0971-464d-af18-16e131392dac tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657846 Jun 23 10:52:40.815029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 165/343] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:52:40.829194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d503e569-7783-4f4a-9902-7ccb676e828d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:40.831180 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d503e569-7783-4f4a-9902-7ccb676e828d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:40.841816 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2d784d33-59c7-48f8-b2a4-a6f8a514c91b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:40.853164 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2d784d33-59c7-48f8-b2a4-a6f8a514c91b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.235846 Jun 23 10:52:40.854358 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 179/344] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:40 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:40.902568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d503e569-7783-4f4a-9902-7ccb676e828d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:40.925407 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d503e569-7783-4f4a-9902-7ccb676e828d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1258 microversion: 2.1 time: 0.103792 Jun 23 10:52:40.926152 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 166/345] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:40 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1258 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:41.872949 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-705c6c0f-ca36-43e3-95d2-e3033c629b4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:41.873990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-705c6c0f-ca36-43e3-95d2-e3033c629b4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:41.885341 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-705c6c0f-ca36-43e3-95d2-e3033c629b4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:41.886041 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-705c6c0f-ca36-43e3-95d2-e3033c629b4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:41.886985 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-705c6c0f-ca36-43e3-95d2-e3033c629b4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:41.887520 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-705c6c0f-ca36-43e3-95d2-e3033c629b4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:41.960930 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2d4316f3-64b7-4a13-9c11-8c995a01d747 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:41.960930 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2d4316f3-64b7-4a13-9c11-8c995a01d747 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:41.974758 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d4316f3-64b7-4a13-9c11-8c995a01d747 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:41.975471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d4316f3-64b7-4a13-9c11-8c995a01d747 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:41.976529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d4316f3-64b7-4a13-9c11-8c995a01d747 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:41.977109 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d4316f3-64b7-4a13-9c11-8c995a01d747 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:42.118527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2d4316f3-64b7-4a13-9c11-8c995a01d747 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:42.128456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2d4316f3-64b7-4a13-9c11-8c995a01d747 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1310 microversion: 2.1 time: 0.180503 Jun 23 10:52:42.129124 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 167/346] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:41 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1310 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:42.206307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-705c6c0f-ca36-43e3-95d2-e3033c629b4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:42.214436 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-705c6c0f-ca36-43e3-95d2-e3033c629b4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1501 microversion: 2.1 time: 0.346072 Jun 23 10:52:42.214929 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 180/347] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:41 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:42.232705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05408451-25d2-4f72-9812-ff184c123037"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:52:42.234228 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:42.241003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:42.241718 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:42.242679 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:42.243572 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:42.275986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] HTTP exception thrown: Cannot 'attach_volume' instance bdecdfe5-d298-4823-a396-cf390e769f92 while it is in vm_state rescued Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Request method failure captured: Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: POST /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92/os-volume_attachments HTTP/1.1 Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 74 Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgvRgPZd-B_64ft6SWQKWYQrdfYdRK3rH49v70jABcjg2aJorfdpCiePsKlYrulilBUvCm1hQU-ZZR_2zNn-lsf0oJgctRN6MpIzT7LQnot0J45gZ6Q13Fx1smgynpjCQiB_5V-vYmSFkjDF9UFZDCIuhAjfLfpTkGw4uI5ZAbF2E Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:52:42.277724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eacce04e67d14a2f8ae63f5cd115b69c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: d230950f9e984a8b878d7d0f74dda3ce Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {"volumeAttachment": {"volumeId": "05408451-25d2-4f72-9812-ff184c123037"}} Jun 23 10:52:42.279060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Cannot 'attach_volume' instance bdecdfe5-d298-4823-a396-cf390e769f92 while it is in vm_state rescued Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'server_id': 'bdecdfe5-d298-4823-a396-cf390e769f92', 'body': {'volumeAttachment': {'volumeId': '05408451-25d2-4f72-9812-ff184c123037'}}} Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bdecdfe5-d298-4823-a396-cf390e769f92 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:52:42.279858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bdecdfe5-d298-4823-a396-cf390e769f92 while it is in vm_state rescued Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:52:42.281042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:52:42.282097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:52:42.282097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:52:42.282097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bdecdfe5-d298-4823-a396-cf390e769f92 while it is in vm_state rescued Jun 23 10:52:42.282097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:52:42.282097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Returning 409 to user: Cannot 'attach_volume' instance bdecdfe5-d298-4823-a396-cf390e769f92 while it is in vm_state rescued {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:52:42.286559 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e11711ec-a42d-4745-8e73-3e36641b7091 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051866 Jun 23 10:52:42.290709 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 168/348] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 10:52:42 2022] POST /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 10:52:42.299695 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-28a6be49-034e-4dc3-b25b-caf711ffaf09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:52:42.300229 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-28a6be49-034e-4dc3-b25b-caf711ffaf09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:42.309823 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-28a6be49-034e-4dc3-b25b-caf711ffaf09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:42.310274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-28a6be49-034e-4dc3-b25b-caf711ffaf09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:42.311065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-28a6be49-034e-4dc3-b25b-caf711ffaf09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:42.313880 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-28a6be49-034e-4dc3-b25b-caf711ffaf09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:42.396374 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-28a6be49-034e-4dc3-b25b-caf711ffaf09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92/action" status: 202 len: 0 microversion: 2.1 time: 0.100531 Jun 23 10:52:42.397068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 181/349] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:52:42 2022] POST /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:52:42.404925 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-13e2cce1-f626-4baf-907d-438bba61e8b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:42.406187 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-13e2cce1-f626-4baf-907d-438bba61e8b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:42.413657 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-13e2cce1-f626-4baf-907d-438bba61e8b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:42.414372 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-13e2cce1-f626-4baf-907d-438bba61e8b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:42.415633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-13e2cce1-f626-4baf-907d-438bba61e8b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:42.416273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-13e2cce1-f626-4baf-907d-438bba61e8b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:42.896885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-13e2cce1-f626-4baf-907d-438bba61e8b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:42.909426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-13e2cce1-f626-4baf-907d-438bba61e8b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.508195 Jun 23 10:52:42.921539 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 169/350] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:42 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:43.160482 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-21773e2d-2acf-4563-9ee7-4faf692f8532 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:43.167844 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-21773e2d-2acf-4563-9ee7-4faf692f8532 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:43.181099 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-21773e2d-2acf-4563-9ee7-4faf692f8532 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:43.195487 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-21773e2d-2acf-4563-9ee7-4faf692f8532 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:43.196488 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-21773e2d-2acf-4563-9ee7-4faf692f8532 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:43.197324 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-21773e2d-2acf-4563-9ee7-4faf692f8532 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:43.561845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-21773e2d-2acf-4563-9ee7-4faf692f8532 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:43.581982 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-21773e2d-2acf-4563-9ee7-4faf692f8532 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.431666 Jun 23 10:52:43.587390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 182/351] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:43 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:43.927831 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1bcecde1-3284-479a-aee5-5771f493b8c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:43.929536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1bcecde1-3284-479a-aee5-5771f493b8c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:43.943489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1bcecde1-3284-479a-aee5-5771f493b8c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:43.944256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1bcecde1-3284-479a-aee5-5771f493b8c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:43.949435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1bcecde1-3284-479a-aee5-5771f493b8c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:43.958560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1bcecde1-3284-479a-aee5-5771f493b8c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:44.204679 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1bcecde1-3284-479a-aee5-5771f493b8c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:44.218589 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1bcecde1-3284-479a-aee5-5771f493b8c1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.294608 Jun 23 10:52:44.221169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 170/352] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:43 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:44.605867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8ae6c146-f246-4b0e-a920-f6ed6e34dbbe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:44.606504 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8ae6c146-f246-4b0e-a920-f6ed6e34dbbe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:44.612782 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ae6c146-f246-4b0e-a920-f6ed6e34dbbe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:44.613219 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ae6c146-f246-4b0e-a920-f6ed6e34dbbe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:44.613965 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ae6c146-f246-4b0e-a920-f6ed6e34dbbe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:44.614430 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ae6c146-f246-4b0e-a920-f6ed6e34dbbe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:44.617068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:44.770891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8ae6c146-f246-4b0e-a920-f6ed6e34dbbe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:44.778719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8ae6c146-f246-4b0e-a920-f6ed6e34dbbe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.176702 Jun 23 10:52:44.779368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 183/353] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:44 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:45.239412 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9ffc9db5-6521-43bd-96cd-786f2e1e3123 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:45.240001 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9ffc9db5-6521-43bd-96cd-786f2e1e3123 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:45.249941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9ffc9db5-6521-43bd-96cd-786f2e1e3123 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:45.250404 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9ffc9db5-6521-43bd-96cd-786f2e1e3123 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:45.251177 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9ffc9db5-6521-43bd-96cd-786f2e1e3123 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:45.252237 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9ffc9db5-6521-43bd-96cd-786f2e1e3123 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:45.394862 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9ffc9db5-6521-43bd-96cd-786f2e1e3123 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:45.406598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9ffc9db5-6521-43bd-96cd-786f2e1e3123 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.171980 Jun 23 10:52:45.407453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 171/354] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:45 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:45.797308 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bc0f6d3b-64a5-4e55-8e21-1ee7bb7d25e3 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:45.799617 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bc0f6d3b-64a5-4e55-8e21-1ee7bb7d25e3 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:45.820649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc0f6d3b-64a5-4e55-8e21-1ee7bb7d25e3 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:45.821916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc0f6d3b-64a5-4e55-8e21-1ee7bb7d25e3 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:45.824179 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc0f6d3b-64a5-4e55-8e21-1ee7bb7d25e3 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:45.824630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc0f6d3b-64a5-4e55-8e21-1ee7bb7d25e3 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:46.028256 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bc0f6d3b-64a5-4e55-8e21-1ee7bb7d25e3 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:46.037418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bc0f6d3b-64a5-4e55-8e21-1ee7bb7d25e3 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.243882 Jun 23 10:52:46.038295 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 184/355] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:45 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:46.426374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d58ea36e-ecb6-4e42-9abc-538356916d1f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:46.427101 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d58ea36e-ecb6-4e42-9abc-538356916d1f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:46.434482 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d58ea36e-ecb6-4e42-9abc-538356916d1f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:46.434918 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d58ea36e-ecb6-4e42-9abc-538356916d1f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:46.435678 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d58ea36e-ecb6-4e42-9abc-538356916d1f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:46.436109 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d58ea36e-ecb6-4e42-9abc-538356916d1f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:46.603238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d58ea36e-ecb6-4e42-9abc-538356916d1f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:46.612198 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d58ea36e-ecb6-4e42-9abc-538356916d1f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.191592 Jun 23 10:52:46.612757 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 172/356] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:46 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:47.054426 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3a391712-4212-444e-95f6-a9ba235ec364 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:47.055036 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3a391712-4212-444e-95f6-a9ba235ec364 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:47.061360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3a391712-4212-444e-95f6-a9ba235ec364 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:47.061809 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3a391712-4212-444e-95f6-a9ba235ec364 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:47.062616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3a391712-4212-444e-95f6-a9ba235ec364 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:47.063060 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3a391712-4212-444e-95f6-a9ba235ec364 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:47.214487 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3a391712-4212-444e-95f6-a9ba235ec364 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:47.223133 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3a391712-4212-444e-95f6-a9ba235ec364 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.172466 Jun 23 10:52:47.223693 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 185/357] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:47 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:47.631217 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-16929a11-ac02-4b40-beb7-e0e07e970b89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:47.631848 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-16929a11-ac02-4b40-beb7-e0e07e970b89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:47.638900 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-16929a11-ac02-4b40-beb7-e0e07e970b89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:47.639638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-16929a11-ac02-4b40-beb7-e0e07e970b89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:47.640569 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-16929a11-ac02-4b40-beb7-e0e07e970b89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:47.641063 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-16929a11-ac02-4b40-beb7-e0e07e970b89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:47.786546 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-16929a11-ac02-4b40-beb7-e0e07e970b89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:47.794882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-16929a11-ac02-4b40-beb7-e0e07e970b89 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.168817 Jun 23 10:52:47.795442 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 173/358] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:47 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:48.240214 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-da23f890-9cc5-4137-bbb2-5f581456d42c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:48.240958 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-da23f890-9cc5-4137-bbb2-5f581456d42c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:48.248244 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-da23f890-9cc5-4137-bbb2-5f581456d42c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:48.251168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-da23f890-9cc5-4137-bbb2-5f581456d42c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:48.252694 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-da23f890-9cc5-4137-bbb2-5f581456d42c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:48.253414 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-da23f890-9cc5-4137-bbb2-5f581456d42c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:48.463550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-da23f890-9cc5-4137-bbb2-5f581456d42c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:48.473373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-da23f890-9cc5-4137-bbb2-5f581456d42c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.237248 Jun 23 10:52:48.473942 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 186/359] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:48 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:48.814396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-23922058-b0ab-4434-83ec-dfd25d6d68b0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:48.815843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-23922058-b0ab-4434-83ec-dfd25d6d68b0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:48.823229 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23922058-b0ab-4434-83ec-dfd25d6d68b0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:48.823941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23922058-b0ab-4434-83ec-dfd25d6d68b0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:48.824747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23922058-b0ab-4434-83ec-dfd25d6d68b0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:48.825180 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23922058-b0ab-4434-83ec-dfd25d6d68b0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:48.994032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-23922058-b0ab-4434-83ec-dfd25d6d68b0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:49.003292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-23922058-b0ab-4434-83ec-dfd25d6d68b0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.193661 Jun 23 10:52:49.013347 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 174/360] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:48 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:49.491806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b2b51c41-90ba-4244-90ef-01b10f6d79f6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:49.493580 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b2b51c41-90ba-4244-90ef-01b10f6d79f6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:49.500748 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b2b51c41-90ba-4244-90ef-01b10f6d79f6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:49.501205 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b2b51c41-90ba-4244-90ef-01b10f6d79f6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:49.502275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b2b51c41-90ba-4244-90ef-01b10f6d79f6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:49.502984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b2b51c41-90ba-4244-90ef-01b10f6d79f6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:49.701586 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b2b51c41-90ba-4244-90ef-01b10f6d79f6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:49.736764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b2b51c41-90ba-4244-90ef-01b10f6d79f6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.229155 Jun 23 10:52:49.739596 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 187/361] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:49 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:50.021347 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4f02bb0b-90a0-440e-83a0-4eefc5839881 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:50.024551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4f02bb0b-90a0-440e-83a0-4eefc5839881 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:50.046605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f02bb0b-90a0-440e-83a0-4eefc5839881 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:50.046605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f02bb0b-90a0-440e-83a0-4eefc5839881 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:50.046605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f02bb0b-90a0-440e-83a0-4eefc5839881 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:50.046605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f02bb0b-90a0-440e-83a0-4eefc5839881 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:50.311635 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4f02bb0b-90a0-440e-83a0-4eefc5839881 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:50.320804 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4f02bb0b-90a0-440e-83a0-4eefc5839881 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.303988 Jun 23 10:52:50.321389 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 175/362] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:50 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:50.761595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-17348cdf-2822-4b6c-af7e-6ca44068743b tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:50.762276 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-17348cdf-2822-4b6c-af7e-6ca44068743b tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:50.778726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=4 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:50.809025 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-17348cdf-2822-4b6c-af7e-6ca44068743b tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:50.810043 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-17348cdf-2822-4b6c-af7e-6ca44068743b tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:50.811634 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-17348cdf-2822-4b6c-af7e-6ca44068743b tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:50.812180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-17348cdf-2822-4b6c-af7e-6ca44068743b tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:51.032074 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-17348cdf-2822-4b6c-af7e-6ca44068743b tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:51.051098 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-17348cdf-2822-4b6c-af7e-6ca44068743b tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.294044 Jun 23 10:52:51.052355 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 188/363] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:50 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:51.340750 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f24efcd9-7bb3-42e3-8f83-544781ea1225 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:51.342517 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f24efcd9-7bb3-42e3-8f83-544781ea1225 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:51.349764 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:51.351427 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=8 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:51.356143 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f24efcd9-7bb3-42e3-8f83-544781ea1225 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:51.357218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f24efcd9-7bb3-42e3-8f83-544781ea1225 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:51.358895 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f24efcd9-7bb3-42e3-8f83-544781ea1225 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:51.359767 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f24efcd9-7bb3-42e3-8f83-544781ea1225 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:51.575770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f24efcd9-7bb3-42e3-8f83-544781ea1225 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:51.590151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f24efcd9-7bb3-42e3-8f83-544781ea1225 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.253846 Jun 23 10:52:51.594377 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 176/364] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:51 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:52.069659 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4a02dcc7-b2e2-480d-8e7c-d85a758ac173 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:52.071599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4a02dcc7-b2e2-480d-8e7c-d85a758ac173 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:52.085494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a02dcc7-b2e2-480d-8e7c-d85a758ac173 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:52.086237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a02dcc7-b2e2-480d-8e7c-d85a758ac173 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:52.087495 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a02dcc7-b2e2-480d-8e7c-d85a758ac173 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:52.088392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a02dcc7-b2e2-480d-8e7c-d85a758ac173 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:52.281574 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4a02dcc7-b2e2-480d-8e7c-d85a758ac173 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:52.291709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4a02dcc7-b2e2-480d-8e7c-d85a758ac173 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.227422 Jun 23 10:52:52.292351 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 189/365] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:52 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:52.611568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c403d36d-722f-413b-aac8-adda8c573221 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:52.612584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c403d36d-722f-413b-aac8-adda8c573221 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:52.624848 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c403d36d-722f-413b-aac8-adda8c573221 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:52.625578 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c403d36d-722f-413b-aac8-adda8c573221 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:52.628499 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c403d36d-722f-413b-aac8-adda8c573221 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:52.629290 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c403d36d-722f-413b-aac8-adda8c573221 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:52.816206 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c403d36d-722f-413b-aac8-adda8c573221 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:52.824531 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c403d36d-722f-413b-aac8-adda8c573221 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.217301 Jun 23 10:52:52.825132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 177/366] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:52 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:53.308822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-822225e4-ae6b-463a-b417-52410c3a7f3f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:53.309595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-822225e4-ae6b-463a-b417-52410c3a7f3f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:53.316591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-822225e4-ae6b-463a-b417-52410c3a7f3f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:53.317025 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-822225e4-ae6b-463a-b417-52410c3a7f3f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:53.317921 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-822225e4-ae6b-463a-b417-52410c3a7f3f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:53.318517 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-822225e4-ae6b-463a-b417-52410c3a7f3f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:53.463243 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-822225e4-ae6b-463a-b417-52410c3a7f3f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:53.471405 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-822225e4-ae6b-463a-b417-52410c3a7f3f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.166465 Jun 23 10:52:53.471968 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 190/367] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:53 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:53.843539 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-068b4324-761c-4b80-b85b-9172597376ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:53.844514 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-068b4324-761c-4b80-b85b-9172597376ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:53.871795 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-068b4324-761c-4b80-b85b-9172597376ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:53.872247 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-068b4324-761c-4b80-b85b-9172597376ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:53.876749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-068b4324-761c-4b80-b85b-9172597376ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:53.877205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-068b4324-761c-4b80-b85b-9172597376ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:54.185031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-068b4324-761c-4b80-b85b-9172597376ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:54.195313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-068b4324-761c-4b80-b85b-9172597376ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.356937 Jun 23 10:52:54.195884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 178/368] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:53 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:54.488660 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-deab4128-4e1a-4eb3-9ef9-5f45d09be388 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:54.489252 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-deab4128-4e1a-4eb3-9ef9-5f45d09be388 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:54.499968 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-deab4128-4e1a-4eb3-9ef9-5f45d09be388 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:54.500413 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-deab4128-4e1a-4eb3-9ef9-5f45d09be388 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:54.501327 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-deab4128-4e1a-4eb3-9ef9-5f45d09be388 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:54.501923 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-deab4128-4e1a-4eb3-9ef9-5f45d09be388 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:54.683423 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-deab4128-4e1a-4eb3-9ef9-5f45d09be388 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:54.691208 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-deab4128-4e1a-4eb3-9ef9-5f45d09be388 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.207504 Jun 23 10:52:54.691769 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 191/369] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:54 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:55.215176 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-052ff51a-4ff4-4ecc-8bef-c70109477310 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:55.215830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-052ff51a-4ff4-4ecc-8bef-c70109477310 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:55.222984 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-052ff51a-4ff4-4ecc-8bef-c70109477310 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:55.223435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-052ff51a-4ff4-4ecc-8bef-c70109477310 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:55.224205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-052ff51a-4ff4-4ecc-8bef-c70109477310 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:55.224640 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-052ff51a-4ff4-4ecc-8bef-c70109477310 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:55.375406 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-052ff51a-4ff4-4ecc-8bef-c70109477310 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:55.383143 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-052ff51a-4ff4-4ecc-8bef-c70109477310 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.172652 Jun 23 10:52:55.383890 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 179/370] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:55 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:55.708925 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cd897453-a59c-44f4-ac72-b3642ff5cdc6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:55.709523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-cd897453-a59c-44f4-ac72-b3642ff5cdc6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:55.715463 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cd897453-a59c-44f4-ac72-b3642ff5cdc6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:55.715902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cd897453-a59c-44f4-ac72-b3642ff5cdc6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:55.716648 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cd897453-a59c-44f4-ac72-b3642ff5cdc6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:55.717073 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cd897453-a59c-44f4-ac72-b3642ff5cdc6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:55.853090 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cd897453-a59c-44f4-ac72-b3642ff5cdc6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:55.860607 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-cd897453-a59c-44f4-ac72-b3642ff5cdc6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.155958 Jun 23 10:52:55.861957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 192/371] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:55 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:56.175167 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1542191122", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "networks": [{"uuid": "3ffd745f-91b9-41dc-a968-b3b10d98d752"}]}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:52:56.228881 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] validate_networks() for [('3ffd745f-91b9-41dc-a968-b3b10d98d752', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:52:56.400426 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-716f9c30-29a0-463a-8aea-dd35b78f7d16 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:56.401022 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-716f9c30-29a0-463a-8aea-dd35b78f7d16 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:56.407264 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-716f9c30-29a0-463a-8aea-dd35b78f7d16 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:56.408420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-716f9c30-29a0-463a-8aea-dd35b78f7d16 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:56.409207 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-716f9c30-29a0-463a-8aea-dd35b78f7d16 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:56.409646 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-716f9c30-29a0-463a-8aea-dd35b78f7d16 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:56.667501 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-716f9c30-29a0-463a-8aea-dd35b78f7d16 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:56.677376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-716f9c30-29a0-463a-8aea-dd35b78f7d16 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.280659 Jun 23 10:52:56.678255 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 193/372] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:56 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:56.800346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:52:56.801523 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:52:56.802109 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:52:56.802675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:52:56.803195 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:52:56.815939 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:56.816754 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:56.817762 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:56.818429 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:56.838924 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Getting quotas for project 33d03af3f8904c829e5a04755f7e3c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:52:56.843218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Getting quotas for user 9ba1d9d9fe3c4f93b5caa347997814b2 and project 33d03af3f8904c829e5a04755f7e3c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:52:56.856272 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:52:56.858758 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:52:56.879894 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1e5eb7e7-47a8-41a0-9657-ddf26925dfb4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:56.881976 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1e5eb7e7-47a8-41a0-9657-ddf26925dfb4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:56.890804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1e5eb7e7-47a8-41a0-9657-ddf26925dfb4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:56.891240 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1e5eb7e7-47a8-41a0-9657-ddf26925dfb4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:56.892186 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1e5eb7e7-47a8-41a0-9657-ddf26925dfb4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:56.892607 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1e5eb7e7-47a8-41a0-9657-ddf26925dfb4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:56.921320 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-db6aef20-c7e3-4f8a-a11b-87065cb13234 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750805 Jun 23 10:52:56.923061 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 180/373] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:52:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:52:56.935359 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-832fa000-fdd7-4c28-a56b-dda4ff36e9e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:56.935986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-832fa000-fdd7-4c28-a56b-dda4ff36e9e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:57.022558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-832fa000-fdd7-4c28-a56b-dda4ff36e9e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:57.029856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-832fa000-fdd7-4c28-a56b-dda4ff36e9e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1214 microversion: 2.1 time: 0.100124 Jun 23 10:52:57.030441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 181/374] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:56 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:57.105071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1e5eb7e7-47a8-41a0-9657-ddf26925dfb4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:57.115913 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1e5eb7e7-47a8-41a0-9657-ddf26925dfb4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.241885 Jun 23 10:52:57.116520 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 194/375] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:56 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:57.696380 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-56070fd7-6de0-4b9a-ae8d-ba0a847ef32f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:57.696960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-56070fd7-6de0-4b9a-ae8d-ba0a847ef32f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:57.703693 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56070fd7-6de0-4b9a-ae8d-ba0a847ef32f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:57.704153 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56070fd7-6de0-4b9a-ae8d-ba0a847ef32f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:57.705447 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56070fd7-6de0-4b9a-ae8d-ba0a847ef32f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:57.705873 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56070fd7-6de0-4b9a-ae8d-ba0a847ef32f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:57.871496 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-56070fd7-6de0-4b9a-ae8d-ba0a847ef32f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:57.881634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-56070fd7-6de0-4b9a-ae8d-ba0a847ef32f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.189753 Jun 23 10:52:57.882561 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 182/376] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:57 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:58.048700 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b838163d-1e94-4b2b-85b6-4ce06b0ddc3e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:58.049225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b838163d-1e94-4b2b-85b6-4ce06b0ddc3e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:58.056257 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b838163d-1e94-4b2b-85b6-4ce06b0ddc3e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:58.056970 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b838163d-1e94-4b2b-85b6-4ce06b0ddc3e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:58.057739 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b838163d-1e94-4b2b-85b6-4ce06b0ddc3e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:58.058170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b838163d-1e94-4b2b-85b6-4ce06b0ddc3e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:58.121378 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b838163d-1e94-4b2b-85b6-4ce06b0ddc3e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:58.129517 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b838163d-1e94-4b2b-85b6-4ce06b0ddc3e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1218 microversion: 2.1 time: 0.085220 Jun 23 10:52:58.130082 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 195/377] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:58 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:58.133822 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-66b1e4cb-a9fc-4ba1-8288-055d7c6bb650 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:58.134468 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-66b1e4cb-a9fc-4ba1-8288-055d7c6bb650 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:58.140647 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66b1e4cb-a9fc-4ba1-8288-055d7c6bb650 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:58.141089 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66b1e4cb-a9fc-4ba1-8288-055d7c6bb650 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:58.141908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66b1e4cb-a9fc-4ba1-8288-055d7c6bb650 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:58.143710 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66b1e4cb-a9fc-4ba1-8288-055d7c6bb650 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:58.291268 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-66b1e4cb-a9fc-4ba1-8288-055d7c6bb650 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:58.303740 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-66b1e4cb-a9fc-4ba1-8288-055d7c6bb650 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.173314 Jun 23 10:52:58.304914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 183/378] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:58 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:58.899427 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9d7d1c0d-5176-4a14-a041-664721efb00c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:58.900037 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9d7d1c0d-5176-4a14-a041-664721efb00c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:58.906443 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9d7d1c0d-5176-4a14-a041-664721efb00c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:58.906891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9d7d1c0d-5176-4a14-a041-664721efb00c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:58.908183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9d7d1c0d-5176-4a14-a041-664721efb00c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:58.908672 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9d7d1c0d-5176-4a14-a041-664721efb00c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:59.146515 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-43e9f1fa-3d7b-425e-a228-b19cb08ed592 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:59.147047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-43e9f1fa-3d7b-425e-a228-b19cb08ed592 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:59.162543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-43e9f1fa-3d7b-425e-a228-b19cb08ed592 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:59.163095 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-43e9f1fa-3d7b-425e-a228-b19cb08ed592 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:59.164143 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-43e9f1fa-3d7b-425e-a228-b19cb08ed592 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:59.164670 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-43e9f1fa-3d7b-425e-a228-b19cb08ed592 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:59.180349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9d7d1c0d-5176-4a14-a041-664721efb00c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:59.185133 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:59.196237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9d7d1c0d-5176-4a14-a041-664721efb00c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.300095 Jun 23 10:52:59.206361 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 196/379] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:58 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:52:59.274233 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-43e9f1fa-3d7b-425e-a228-b19cb08ed592 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:59.284664 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-43e9f1fa-3d7b-425e-a228-b19cb08ed592 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1218 microversion: 2.1 time: 0.141818 Jun 23 10:52:59.285785 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 184/380] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:59 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:52:59.327467 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c93300d1-c5d8-42e7-921b-f8addca8a093 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:52:59.328066 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c93300d1-c5d8-42e7-921b-f8addca8a093 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:52:59.334802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c93300d1-c5d8-42e7-921b-f8addca8a093 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:59.335245 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c93300d1-c5d8-42e7-921b-f8addca8a093 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:59.336009 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c93300d1-c5d8-42e7-921b-f8addca8a093 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:52:59.336437 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c93300d1-c5d8-42e7-921b-f8addca8a093 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:52:59.585525 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c93300d1-c5d8-42e7-921b-f8addca8a093 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:52:59.593031 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c93300d1-c5d8-42e7-921b-f8addca8a093 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.271838 Jun 23 10:52:59.593756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 197/381] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:52:59 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:00.217037 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ea64d403-3fb8-40da-816a-04367f8b43ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:00.220076 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ea64d403-3fb8-40da-816a-04367f8b43ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:00.240178 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea64d403-3fb8-40da-816a-04367f8b43ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:00.240629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea64d403-3fb8-40da-816a-04367f8b43ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:00.241409 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea64d403-3fb8-40da-816a-04367f8b43ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:00.241956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea64d403-3fb8-40da-816a-04367f8b43ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:00.311468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-828a8f22-6db7-4ab6-aa6c-231810ef2b12 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:00.312100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-828a8f22-6db7-4ab6-aa6c-231810ef2b12 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:00.341381 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:00.383235 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-828a8f22-6db7-4ab6-aa6c-231810ef2b12 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:00.383703 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-828a8f22-6db7-4ab6-aa6c-231810ef2b12 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:00.384519 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-828a8f22-6db7-4ab6-aa6c-231810ef2b12 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:00.384959 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-828a8f22-6db7-4ab6-aa6c-231810ef2b12 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:00.653708 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-828a8f22-6db7-4ab6-aa6c-231810ef2b12 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:00.663289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-828a8f22-6db7-4ab6-aa6c-231810ef2b12 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1218 microversion: 2.1 time: 0.365083 Jun 23 10:53:00.668145 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 198/382] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:00 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1218 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:00.685041 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-47fc0468-65cf-4c4a-a2f6-8310c2f840eb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:00.687254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-47fc0468-65cf-4c4a-a2f6-8310c2f840eb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:00.703576 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-47fc0468-65cf-4c4a-a2f6-8310c2f840eb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:00.705627 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-47fc0468-65cf-4c4a-a2f6-8310c2f840eb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:00.707288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-47fc0468-65cf-4c4a-a2f6-8310c2f840eb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:00.709965 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-47fc0468-65cf-4c4a-a2f6-8310c2f840eb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:00.749033 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ea64d403-3fb8-40da-816a-04367f8b43ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:00.763480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ea64d403-3fb8-40da-816a-04367f8b43ba tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.550638 Jun 23 10:53:00.764060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 185/383] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:00 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:01.032952 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-47fc0468-65cf-4c4a-a2f6-8310c2f840eb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:01.035379 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:01.046655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-47fc0468-65cf-4c4a-a2f6-8310c2f840eb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.377055 Jun 23 10:53:01.069531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 199/384] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:00 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:01.689800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b0010e76-196e-419b-a12e-7888aa0afe19 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:01.691581 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b0010e76-196e-419b-a12e-7888aa0afe19 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:01.694868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:01.709709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-85e6eff8-9e5b-4553-a8b1-1b96bd7d9679 req-a0939f76-4966-4340-bd15-dc8dd9e4221b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7546151-13d3-41c1-b4df-a064682f764a", "tag": "e3febbb8-c828-460d-9a89-e3851649705f"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:01.711529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0010e76-196e-419b-a12e-7888aa0afe19 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:01.712035 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0010e76-196e-419b-a12e-7888aa0afe19 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:01.713033 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0010e76-196e-419b-a12e-7888aa0afe19 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:01.713469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0010e76-196e-419b-a12e-7888aa0afe19 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:01.741162 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-85e6eff8-9e5b-4553-a8b1-1b96bd7d9679 req-a0939f76-4966-4340-bd15-dc8dd9e4221b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:01.741907 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-85e6eff8-9e5b-4553-a8b1-1b96bd7d9679 req-a0939f76-4966-4340-bd15-dc8dd9e4221b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:01.771043 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-85e6eff8-9e5b-4553-a8b1-1b96bd7d9679 req-a0939f76-4966-4340-bd15-dc8dd9e4221b service nova] Creating event network-changed:e3febbb8-c828-460d-9a89-e3851649705f for instance a7546151-13d3-41c1-b4df-a064682f764a on hv-cinder-84614 Jun 23 10:53:01.780252 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-85e6eff8-9e5b-4553-a8b1-1b96bd7d9679 req-a0939f76-4966-4340-bd15-dc8dd9e4221b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075633 Jun 23 10:53:01.781427 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 200/385] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:53:01.791952 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9bf582c8-2ce1-4447-b29d-dd3b91c72495 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:01.792915 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9bf582c8-2ce1-4447-b29d-dd3b91c72495 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:01.802184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9bf582c8-2ce1-4447-b29d-dd3b91c72495 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:01.802907 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9bf582c8-2ce1-4447-b29d-dd3b91c72495 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:01.803851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9bf582c8-2ce1-4447-b29d-dd3b91c72495 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:01.804480 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9bf582c8-2ce1-4447-b29d-dd3b91c72495 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:01.862694 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b0010e76-196e-419b-a12e-7888aa0afe19 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:01.870775 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b0010e76-196e-419b-a12e-7888aa0afe19 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1274 microversion: 2.1 time: 0.185422 Jun 23 10:53:01.877029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 186/386] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:01 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:02.065463 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1a7d0713-fe62-4b0d-9eec-c65e8f994056 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:02.066470 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1a7d0713-fe62-4b0d-9eec-c65e8f994056 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:02.072994 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a7d0713-fe62-4b0d-9eec-c65e8f994056 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:02.073961 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a7d0713-fe62-4b0d-9eec-c65e8f994056 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:02.074774 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a7d0713-fe62-4b0d-9eec-c65e8f994056 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:02.075415 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a7d0713-fe62-4b0d-9eec-c65e8f994056 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:02.101958 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9bf582c8-2ce1-4447-b29d-dd3b91c72495 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:02.112759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9bf582c8-2ce1-4447-b29d-dd3b91c72495 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.327087 Jun 23 10:53:02.113463 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 201/387] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:01 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:02.264773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1a7d0713-fe62-4b0d-9eec-c65e8f994056 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:02.273205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1a7d0713-fe62-4b0d-9eec-c65e8f994056 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.212880 Jun 23 10:53:02.273784 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 187/388] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:02 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:02.888467 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e97cf54c-26d3-4ffb-8e33-b6af59077b51 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:02.889283 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e97cf54c-26d3-4ffb-8e33-b6af59077b51 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:02.896531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e97cf54c-26d3-4ffb-8e33-b6af59077b51 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:02.897884 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e97cf54c-26d3-4ffb-8e33-b6af59077b51 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:02.898814 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e97cf54c-26d3-4ffb-8e33-b6af59077b51 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:02.899709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e97cf54c-26d3-4ffb-8e33-b6af59077b51 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:02.979786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e97cf54c-26d3-4ffb-8e33-b6af59077b51 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:02.987748 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e97cf54c-26d3-4ffb-8e33-b6af59077b51 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1272 microversion: 2.1 time: 0.103524 Jun 23 10:53:02.988312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 202/389] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:02 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:03.131704 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2eb97402-1932-44ef-8cc6-cb725c9b4b09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:03.132314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2eb97402-1932-44ef-8cc6-cb725c9b4b09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:03.139290 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2eb97402-1932-44ef-8cc6-cb725c9b4b09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:03.139963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2eb97402-1932-44ef-8cc6-cb725c9b4b09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:03.140742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2eb97402-1932-44ef-8cc6-cb725c9b4b09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:03.141178 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2eb97402-1932-44ef-8cc6-cb725c9b4b09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:03.291007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2e385fe3-09d0-4e24-b5ae-228e5a47b75e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:03.292278 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2e385fe3-09d0-4e24-b5ae-228e5a47b75e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:03.301741 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2e385fe3-09d0-4e24-b5ae-228e5a47b75e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:03.302738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2e385fe3-09d0-4e24-b5ae-228e5a47b75e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:03.303686 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2e385fe3-09d0-4e24-b5ae-228e5a47b75e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:03.304420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2e385fe3-09d0-4e24-b5ae-228e5a47b75e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:03.434604 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2eb97402-1932-44ef-8cc6-cb725c9b4b09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:03.462872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2eb97402-1932-44ef-8cc6-cb725c9b4b09 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.334886 Jun 23 10:53:03.471184 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 188/390] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:03 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:03.566719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2e385fe3-09d0-4e24-b5ae-228e5a47b75e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:03.577282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2e385fe3-09d0-4e24-b5ae-228e5a47b75e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.290486 Jun 23 10:53:03.578099 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 203/391] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:03 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:04.009178 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9a6e8791-0d9a-411c-b330-b625bea59e2b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:04.009795 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9a6e8791-0d9a-411c-b330-b625bea59e2b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:04.022651 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9a6e8791-0d9a-411c-b330-b625bea59e2b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:04.023118 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9a6e8791-0d9a-411c-b330-b625bea59e2b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:04.024562 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9a6e8791-0d9a-411c-b330-b625bea59e2b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:04.024906 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9a6e8791-0d9a-411c-b330-b625bea59e2b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:04.155282 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9a6e8791-0d9a-411c-b330-b625bea59e2b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:04.165148 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9a6e8791-0d9a-411c-b330-b625bea59e2b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1272 microversion: 2.1 time: 0.162308 Jun 23 10:53:04.175365 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 189/392] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:04 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:04.484581 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5c2bedd3-8471-4c6a-8436-0e0da78c16a3 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:04.485256 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5c2bedd3-8471-4c6a-8436-0e0da78c16a3 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:04.500387 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5c2bedd3-8471-4c6a-8436-0e0da78c16a3 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:04.501128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5c2bedd3-8471-4c6a-8436-0e0da78c16a3 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:04.502265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5c2bedd3-8471-4c6a-8436-0e0da78c16a3 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:04.502877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5c2bedd3-8471-4c6a-8436-0e0da78c16a3 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:04.593914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9e043590-d9e3-47f8-aaaa-59d131c86e3a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:04.594599 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9e043590-d9e3-47f8-aaaa-59d131c86e3a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:04.624763 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9e043590-d9e3-47f8-aaaa-59d131c86e3a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:04.628120 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9e043590-d9e3-47f8-aaaa-59d131c86e3a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:04.632375 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9e043590-d9e3-47f8-aaaa-59d131c86e3a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:04.633426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9e043590-d9e3-47f8-aaaa-59d131c86e3a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:05.134138 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9e043590-d9e3-47f8-aaaa-59d131c86e3a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:05.148011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9e043590-d9e3-47f8-aaaa-59d131c86e3a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.557952 Jun 23 10:53:05.153636 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 190/393] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:04 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:05.183069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-15eec49b-c582-4ae9-a6c8-fdfe52d33a6b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:05.184474 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-15eec49b-c582-4ae9-a6c8-fdfe52d33a6b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:05.189224 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5c2bedd3-8471-4c6a-8436-0e0da78c16a3 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:05.196651 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-15eec49b-c582-4ae9-a6c8-fdfe52d33a6b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:05.197199 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-15eec49b-c582-4ae9-a6c8-fdfe52d33a6b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:05.197383 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5c2bedd3-8471-4c6a-8436-0e0da78c16a3 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1509 microversion: 2.1 time: 0.720178 Jun 23 10:53:05.198065 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-15eec49b-c582-4ae9-a6c8-fdfe52d33a6b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:05.198807 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-15eec49b-c582-4ae9-a6c8-fdfe52d33a6b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:05.201357 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 204/394] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:04 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1509 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:05.347828 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-15eec49b-c582-4ae9-a6c8-fdfe52d33a6b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:05.362834 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-15eec49b-c582-4ae9-a6c8-fdfe52d33a6b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1272 microversion: 2.1 time: 0.182281 Jun 23 10:53:05.364927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 191/395] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:05 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:06.170183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2a45c027-77d6-4a72-b62d-61b68985726d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:06.170568 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2a45c027-77d6-4a72-b62d-61b68985726d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:06.178018 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a45c027-77d6-4a72-b62d-61b68985726d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:06.178560 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a45c027-77d6-4a72-b62d-61b68985726d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:06.179256 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a45c027-77d6-4a72-b62d-61b68985726d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:06.179681 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a45c027-77d6-4a72-b62d-61b68985726d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:06.223290 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a09f0be6-a480-4084-bbc1-fc9be9879e30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:06.224650 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a09f0be6-a480-4084-bbc1-fc9be9879e30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:06.231347 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a09f0be6-a480-4084-bbc1-fc9be9879e30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:06.232219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a09f0be6-a480-4084-bbc1-fc9be9879e30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:06.233165 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a09f0be6-a480-4084-bbc1-fc9be9879e30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:06.233755 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a09f0be6-a480-4084-bbc1-fc9be9879e30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:06.504405 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2a45c027-77d6-4a72-b62d-61b68985726d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:06.518593 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2a45c027-77d6-4a72-b62d-61b68985726d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.351622 Jun 23 10:53:06.533009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a09f0be6-a480-4084-bbc1-fc9be9879e30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:06.542095 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a09f0be6-a480-4084-bbc1-fc9be9879e30 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1515 microversion: 2.1 time: 0.325404 Jun 23 10:53:06.542716 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 192/397] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:06 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:06.559178 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 205/397] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:06 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:06.588123 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e07e19a3-d3d0-4c7a-9e04-f6bfa13e9ac7 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:06.588917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e07e19a3-d3d0-4c7a-9e04-f6bfa13e9ac7 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:06.610232 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e07e19a3-d3d0-4c7a-9e04-f6bfa13e9ac7 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:06.610232 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e07e19a3-d3d0-4c7a-9e04-f6bfa13e9ac7 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:06.610232 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e07e19a3-d3d0-4c7a-9e04-f6bfa13e9ac7 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:06.610232 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e07e19a3-d3d0-4c7a-9e04-f6bfa13e9ac7 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:06.828617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:06.849567 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e07e19a3-d3d0-4c7a-9e04-f6bfa13e9ac7 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:06.864989 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e07e19a3-d3d0-4c7a-9e04-f6bfa13e9ac7 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.304088 Jun 23 10:53:06.866479 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 193/398] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:06 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:07.537061 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e704bf34-9ee4-4d1f-8916-7b7e95ac34da tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:07.538350 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e704bf34-9ee4-4d1f-8916-7b7e95ac34da tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:07.545624 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e704bf34-9ee4-4d1f-8916-7b7e95ac34da tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:07.546137 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e704bf34-9ee4-4d1f-8916-7b7e95ac34da tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:07.546952 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e704bf34-9ee4-4d1f-8916-7b7e95ac34da tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:07.547385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e704bf34-9ee4-4d1f-8916-7b7e95ac34da tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:07.787326 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e704bf34-9ee4-4d1f-8916-7b7e95ac34da tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:07.797027 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e704bf34-9ee4-4d1f-8916-7b7e95ac34da tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.264724 Jun 23 10:53:07.799547 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 206/399] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:07 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:07.883668 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1b223362-e19a-43ae-951c-4e0658460175 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:07.885450 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1b223362-e19a-43ae-951c-4e0658460175 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:07.895814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=8 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:07.905914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b223362-e19a-43ae-951c-4e0658460175 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:07.906862 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b223362-e19a-43ae-951c-4e0658460175 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:07.909071 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b223362-e19a-43ae-951c-4e0658460175 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:07.909517 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b223362-e19a-43ae-951c-4e0658460175 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:08.104159 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-dd91167b-3512-44d5-bb80-324ae42a3012 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'create', calling method: .version_select at 0x7f8dc9404280>, body: {"keypair": {"name": "tempest-keypair-932832116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoT4eP5aFfZ+2bER71Ik/33T75F4N2UMgcq3vt7uid9PbXxtUh82BgPTgmLkrvGdcYt9RXj93Wq8xsGQHSgSLvocgN8XbBi3Y/7vK2X2u+1TQzIKBPOiSNqpfOBoa6pNg=="}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:08.128090 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-dd91167b-3512-44d5-bb80-324ae42a3012 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Getting quotas for project eacce04e67d14a2f8ae63f5cd115b69c. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:53:08.133473 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-dd91167b-3512-44d5-bb80-324ae42a3012 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Getting quotas for user d230950f9e984a8b878d7d0f74dda3ce and project eacce04e67d14a2f8ae63f5cd115b69c. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:53:08.139718 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1b223362-e19a-43ae-951c-4e0658460175 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:08.149014 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1b223362-e19a-43ae-951c-4e0658460175 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.269423 Jun 23 10:53:08.150205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 194/400] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:07 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:08.163287 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-dd91167b-3512-44d5-bb80-324ae42a3012 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063916 Jun 23 10:53:08.164148 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 207/401] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 10:53:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:53:08.438583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-941dc5fb-6b03-4e0b-b5a9-ff2a83f9772d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Action: 'create', calling method: .version_select at 0x7f8dc94b7310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1984337626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5uNM4S8QfpE2hJGhMuVrcAEeTXmQHinQXeVC/yW8/h6xTtknYp5vAf5wTqMjkLCNkLdVB4V1oF00XIzkBFLs+9OQ1oFlvRqmhub1v67B876yl9gNHFiHZOZojApIUE5Q=="}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:08.456326 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-941dc5fb-6b03-4e0b-b5a9-ff2a83f9772d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Getting quotas for project 79dbb107721b4406b5c3e2f5081034fd. Resources: {'key_pairs'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:53:08.460970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-941dc5fb-6b03-4e0b-b5a9-ff2a83f9772d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Getting quotas for user 10ae039c34c442f880c51aaf9024db8d and project 79dbb107721b4406b5c3e2f5081034fd. Resources: {'key_pairs'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:53:08.479403 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-941dc5fb-6b03-4e0b-b5a9-ff2a83f9772d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [2d955282-5b7a-47a7-af66-d296301641f3] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 10:53:08.816398 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-49e22594-da3c-4953-98d1-08cbb97d72fd tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:08.817209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-49e22594-da3c-4953-98d1-08cbb97d72fd tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:08.824550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-49e22594-da3c-4953-98d1-08cbb97d72fd tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:08.825148 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-49e22594-da3c-4953-98d1-08cbb97d72fd tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:08.826066 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-49e22594-da3c-4953-98d1-08cbb97d72fd tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:08.826628 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-49e22594-da3c-4953-98d1-08cbb97d72fd tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:08.972882 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-49e22594-da3c-4953-98d1-08cbb97d72fd tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:08.980773 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-49e22594-da3c-4953-98d1-08cbb97d72fd tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.168936 Jun 23 10:53:08.981716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 208/402] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:08 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:09.167359 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8ef8d653-7b21-423c-b6e5-7ccca860e20c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:09.167968 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8ef8d653-7b21-423c-b6e5-7ccca860e20c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:09.174272 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ef8d653-7b21-423c-b6e5-7ccca860e20c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:09.174782 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ef8d653-7b21-423c-b6e5-7ccca860e20c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:09.175572 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ef8d653-7b21-423c-b6e5-7ccca860e20c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:09.176006 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ef8d653-7b21-423c-b6e5-7ccca860e20c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:09.318086 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8ef8d653-7b21-423c-b6e5-7ccca860e20c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:09.326595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8ef8d653-7b21-423c-b6e5-7ccca860e20c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.163105 Jun 23 10:53:09.336965 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 209/403] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:09 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:09.487399 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [None req-941dc5fb-6b03-4e0b-b5a9-ff2a83f9772d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [2d955282-5b7a-47a7-af66-d296301641f3] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 46888. Jun 23 10:53:09.503446 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-941dc5fb-6b03-4e0b-b5a9-ff2a83f9772d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.307782 Jun 23 10:53:09.504052 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 195/404] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 10:53:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:09.599655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-245134701", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "336b121a-ed5e-44ff-8b8f-ca20d4537d74"}], "security_groups": [{"name": "tempest-securitygroup--378925834"}], "key_name": "tempest-keypair-932832116", "user_data": "}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:09.755151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.network.neutron [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] validate_networks() for [('336b121a-ed5e-44ff-8b8f-ca20d4537d74', None, None, None, None, None)] {{(pid=129460) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:53:09.999957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4f333b0e-441b-4ce4-a145-33adebbfe892 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:10.000923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4f333b0e-441b-4ce4-a145-33adebbfe892 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:10.008147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f333b0e-441b-4ce4-a145-33adebbfe892 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:10.008796 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f333b0e-441b-4ce4-a145-33adebbfe892 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:10.009564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f333b0e-441b-4ce4-a145-33adebbfe892 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:10.009993 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f333b0e-441b-4ce4-a145-33adebbfe892 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:10.248856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4f333b0e-441b-4ce4-a145-33adebbfe892 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:10.257535 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4f333b0e-441b-4ce4-a145-33adebbfe892 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.262875 Jun 23 10:53:10.258950 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 196/405] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:09 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:10.316373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Flavor limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:53:10.317320 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Image limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:53:10.318344 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Flavor pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:53:10.318960 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Image pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:53:10.319471 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:53:10.330727 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:10.331482 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:10.332529 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:10.333093 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:10.344205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4abdbc1b-dc10-48cb-9d34-33e4333a4da5 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:10.346163 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4abdbc1b-dc10-48cb-9d34-33e4333a4da5 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:10.357849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4abdbc1b-dc10-48cb-9d34-33e4333a4da5 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:10.358480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4abdbc1b-dc10-48cb-9d34-33e4333a4da5 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:10.359327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4abdbc1b-dc10-48cb-9d34-33e4333a4da5 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:10.359827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4abdbc1b-dc10-48cb-9d34-33e4333a4da5 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:10.376295 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Getting quotas for project eacce04e67d14a2f8ae63f5cd115b69c. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:53:10.384120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Getting quotas for user d230950f9e984a8b878d7d0f74dda3ce and project eacce04e67d14a2f8ae63f5cd115b69c. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:53:10.399867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Going to run 1 instances... {{(pid=129460) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:53:10.403575 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129460) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:53:10.460353 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d3b9121e-c583-46d2-81e2-312570a5e80c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.866673 Jun 23 10:53:10.461595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 210/406] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:53:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:53:10.472513 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1527f608-f93d-4b7e-b5fd-d4a464fc47b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:10.475688 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1527f608-f93d-4b7e-b5fd-d4a464fc47b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:10.549621 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1527f608-f93d-4b7e-b5fd-d4a464fc47b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:10.551768 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4abdbc1b-dc10-48cb-9d34-33e4333a4da5 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:10.560264 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4abdbc1b-dc10-48cb-9d34-33e4333a4da5 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.219762 Jun 23 10:53:10.561978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 197/407] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:10 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:10.567014 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1527f608-f93d-4b7e-b5fd-d4a464fc47b2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1244 microversion: 2.1 time: 0.099577 Jun 23 10:53:10.567808 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 211/408] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:10 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1244 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:11.275015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-82dad893-2529-49f9-9c22-481d8b853dbb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:11.275623 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-82dad893-2529-49f9-9c22-481d8b853dbb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:11.282838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82dad893-2529-49f9-9c22-481d8b853dbb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:11.283485 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82dad893-2529-49f9-9c22-481d8b853dbb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:11.284639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82dad893-2529-49f9-9c22-481d8b853dbb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:11.285074 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82dad893-2529-49f9-9c22-481d8b853dbb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:11.424473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-82dad893-2529-49f9-9c22-481d8b853dbb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:11.432457 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-82dad893-2529-49f9-9c22-481d8b853dbb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.161407 Jun 23 10:53:11.433024 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 198/409] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:11 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:11.577772 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6889f5ff-85d7-4ed7-adc5-909d434c5713 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:11.578303 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6889f5ff-85d7-4ed7-adc5-909d434c5713 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:11.586845 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d2a49bdb-8fad-4976-85c2-361dd80287b8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:11.587572 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d2a49bdb-8fad-4976-85c2-361dd80287b8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:11.588069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6889f5ff-85d7-4ed7-adc5-909d434c5713 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:11.588729 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6889f5ff-85d7-4ed7-adc5-909d434c5713 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:11.589729 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6889f5ff-85d7-4ed7-adc5-909d434c5713 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:11.590239 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6889f5ff-85d7-4ed7-adc5-909d434c5713 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:11.594552 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d2a49bdb-8fad-4976-85c2-361dd80287b8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:11.595218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d2a49bdb-8fad-4976-85c2-361dd80287b8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:11.596020 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d2a49bdb-8fad-4976-85c2-361dd80287b8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:11.596589 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d2a49bdb-8fad-4976-85c2-361dd80287b8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:11.693798 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d2a49bdb-8fad-4976-85c2-361dd80287b8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:11.703763 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d2a49bdb-8fad-4976-85c2-361dd80287b8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1248 microversion: 2.1 time: 0.121859 Jun 23 10:53:11.705897 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 199/410] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:11 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1248 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:11.768509 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6889f5ff-85d7-4ed7-adc5-909d434c5713 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:11.777114 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6889f5ff-85d7-4ed7-adc5-909d434c5713 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.203436 Jun 23 10:53:11.777756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 212/411] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:11 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:12.449202 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9eccd630-52e3-4512-b73b-e40f3ecfbffe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:12.449814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9eccd630-52e3-4512-b73b-e40f3ecfbffe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:12.457911 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9eccd630-52e3-4512-b73b-e40f3ecfbffe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:12.458391 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9eccd630-52e3-4512-b73b-e40f3ecfbffe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:12.459168 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9eccd630-52e3-4512-b73b-e40f3ecfbffe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:12.459603 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9eccd630-52e3-4512-b73b-e40f3ecfbffe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:12.601834 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9eccd630-52e3-4512-b73b-e40f3ecfbffe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:12.609745 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9eccd630-52e3-4512-b73b-e40f3ecfbffe tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.164492 Jun 23 10:53:12.611284 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 200/412] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:12 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:12.722103 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0dfc92eb-e73e-484a-b60d-e31c3141cc20 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:12.722831 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0dfc92eb-e73e-484a-b60d-e31c3141cc20 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:12.729054 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dfc92eb-e73e-484a-b60d-e31c3141cc20 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:12.729540 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dfc92eb-e73e-484a-b60d-e31c3141cc20 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:12.730292 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dfc92eb-e73e-484a-b60d-e31c3141cc20 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:12.730794 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dfc92eb-e73e-484a-b60d-e31c3141cc20 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:12.794011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0dfc92eb-e73e-484a-b60d-e31c3141cc20 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:12.794856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e91b4805-031a-430a-8045-126b0677b558 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:12.795588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e91b4805-031a-430a-8045-126b0677b558 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:12.802122 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0dfc92eb-e73e-484a-b60d-e31c3141cc20 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1248 microversion: 2.1 time: 0.085099 Jun 23 10:53:12.802701 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 213/413] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:12 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:12.803242 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e91b4805-031a-430a-8045-126b0677b558 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:12.803686 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e91b4805-031a-430a-8045-126b0677b558 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:12.804453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e91b4805-031a-430a-8045-126b0677b558 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:12.804884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e91b4805-031a-430a-8045-126b0677b558 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:12.978973 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e91b4805-031a-430a-8045-126b0677b558 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:12.992445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e91b4805-031a-430a-8045-126b0677b558 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.197437 Jun 23 10:53:12.993216 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 201/414] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:12 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:13.629634 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f46804e2-c772-4e37-bb70-ec5beb2d44d1 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:13.630568 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f46804e2-c772-4e37-bb70-ec5beb2d44d1 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:13.637741 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f46804e2-c772-4e37-bb70-ec5beb2d44d1 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:13.638191 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f46804e2-c772-4e37-bb70-ec5beb2d44d1 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:13.639004 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f46804e2-c772-4e37-bb70-ec5beb2d44d1 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:13.639440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f46804e2-c772-4e37-bb70-ec5beb2d44d1 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:13.796864 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f46804e2-c772-4e37-bb70-ec5beb2d44d1 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:13.805595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f46804e2-c772-4e37-bb70-ec5beb2d44d1 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.181666 Jun 23 10:53:13.806568 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 214/415] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:13 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:13.821266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e89003a8-e3eb-42d4-a832-297296512522 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:13.821982 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e89003a8-e3eb-42d4-a832-297296512522 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:13.828851 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e89003a8-e3eb-42d4-a832-297296512522 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:13.830215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e89003a8-e3eb-42d4-a832-297296512522 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:13.831823 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e89003a8-e3eb-42d4-a832-297296512522 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:13.832415 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e89003a8-e3eb-42d4-a832-297296512522 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:13.835589 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:13.899963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e89003a8-e3eb-42d4-a832-297296512522 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:13.908539 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e89003a8-e3eb-42d4-a832-297296512522 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1302 microversion: 2.1 time: 0.091368 Jun 23 10:53:13.909285 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 202/416] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:13 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:14.010390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-58f09390-5db8-4d3b-912f-31f887359257 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:14.011401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-58f09390-5db8-4d3b-912f-31f887359257 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:14.019361 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-58f09390-5db8-4d3b-912f-31f887359257 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:14.019801 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-58f09390-5db8-4d3b-912f-31f887359257 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:14.020577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-58f09390-5db8-4d3b-912f-31f887359257 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:14.021008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-58f09390-5db8-4d3b-912f-31f887359257 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:14.165807 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-58f09390-5db8-4d3b-912f-31f887359257 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:14.174202 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-58f09390-5db8-4d3b-912f-31f887359257 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.167819 Jun 23 10:53:14.174906 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 215/417] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:14 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:14.424494 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-c951afad-8d3b-484b-be35-e5e00e95c0d7 req-a40673a9-90dc-4166-a889-e4219a37f6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed60172-efba-4ed3-8e82-3ef05bf9522e", "tag": "e8e9378e-1b9a-47cc-a47e-7c4206ca14c4"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:14.433587 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-c951afad-8d3b-484b-be35-e5e00e95c0d7 req-a40673a9-90dc-4166-a889-e4219a37f6f9 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:14.434021 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-c951afad-8d3b-484b-be35-e5e00e95c0d7 req-a40673a9-90dc-4166-a889-e4219a37f6f9 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:14.445610 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-c951afad-8d3b-484b-be35-e5e00e95c0d7 req-a40673a9-90dc-4166-a889-e4219a37f6f9 service nova] Creating event network-changed:e8e9378e-1b9a-47cc-a47e-7c4206ca14c4 for instance 3ed60172-efba-4ed3-8e82-3ef05bf9522e on hv-cinder-84614 Jun 23 10:53:14.451081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-c951afad-8d3b-484b-be35-e5e00e95c0d7 req-a40673a9-90dc-4166-a889-e4219a37f6f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031673 Jun 23 10:53:14.451673 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 203/418] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:14.714534 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-2d36251f-6828-4434-9b02-cff77991d4d0 req-fbac43e3-3a3c-4677-99f0-668e0506f3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7546151-13d3-41c1-b4df-a064682f764a", "name": "network-vif-plugged", "status": "completed", "tag": "e3febbb8-c828-460d-9a89-e3851649705f"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:14.726550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-2d36251f-6828-4434-9b02-cff77991d4d0 req-fbac43e3-3a3c-4677-99f0-668e0506f3a0 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:14.727003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-2d36251f-6828-4434-9b02-cff77991d4d0 req-fbac43e3-3a3c-4677-99f0-668e0506f3a0 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:14.741799 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-2d36251f-6828-4434-9b02-cff77991d4d0 req-fbac43e3-3a3c-4677-99f0-668e0506f3a0 service nova] Creating event network-vif-plugged:e3febbb8-c828-460d-9a89-e3851649705f for instance a7546151-13d3-41c1-b4df-a064682f764a on hv-cinder-84614 Jun 23 10:53:14.747953 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-2d36251f-6828-4434-9b02-cff77991d4d0 req-fbac43e3-3a3c-4677-99f0-668e0506f3a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036945 Jun 23 10:53:14.748571 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 216/419] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:14.825471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f8b1d7b8-8e27-4853-bc68-d6ed1d12c549 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:14.826838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f8b1d7b8-8e27-4853-bc68-d6ed1d12c549 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:14.839404 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f8b1d7b8-8e27-4853-bc68-d6ed1d12c549 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:14.839404 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f8b1d7b8-8e27-4853-bc68-d6ed1d12c549 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:14.839793 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f8b1d7b8-8e27-4853-bc68-d6ed1d12c549 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:14.840387 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f8b1d7b8-8e27-4853-bc68-d6ed1d12c549 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:14.927523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e5870512-49bb-43d8-a306-e7182f78b8f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:14.929237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e5870512-49bb-43d8-a306-e7182f78b8f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:14.945002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e5870512-49bb-43d8-a306-e7182f78b8f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:14.945719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e5870512-49bb-43d8-a306-e7182f78b8f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:14.946731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e5870512-49bb-43d8-a306-e7182f78b8f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:14.947326 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e5870512-49bb-43d8-a306-e7182f78b8f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:15.010005 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f8b1d7b8-8e27-4853-bc68-d6ed1d12c549 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:15.021050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f8b1d7b8-8e27-4853-bc68-d6ed1d12c549 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.200230 Jun 23 10:53:15.021638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 204/420] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:14 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:15.035521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e5870512-49bb-43d8-a306-e7182f78b8f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:15.044363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e5870512-49bb-43d8-a306-e7182f78b8f8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1302 microversion: 2.1 time: 0.121823 Jun 23 10:53:15.044936 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 217/421] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:14 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:15.192017 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b0a462c2-5340-4e54-a860-09c264a94ad4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:15.192710 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b0a462c2-5340-4e54-a860-09c264a94ad4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:15.199379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0a462c2-5340-4e54-a860-09c264a94ad4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:15.199966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0a462c2-5340-4e54-a860-09c264a94ad4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:15.200966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0a462c2-5340-4e54-a860-09c264a94ad4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:15.202232 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0a462c2-5340-4e54-a860-09c264a94ad4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:15.344620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b0a462c2-5340-4e54-a860-09c264a94ad4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:15.352924 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b0a462c2-5340-4e54-a860-09c264a94ad4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.165565 Jun 23 10:53:15.353491 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 205/422] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:15 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:16.037432 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d0dc4496-378c-437d-bdd2-1da63df54bb9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:16.037990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d0dc4496-378c-437d-bdd2-1da63df54bb9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:16.044126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d0dc4496-378c-437d-bdd2-1da63df54bb9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:16.044575 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d0dc4496-378c-437d-bdd2-1da63df54bb9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:16.045553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d0dc4496-378c-437d-bdd2-1da63df54bb9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:16.045998 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d0dc4496-378c-437d-bdd2-1da63df54bb9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:16.063077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6a7356f1-3417-4890-88b1-63a1542aef32 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:16.065522 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6a7356f1-3417-4890-88b1-63a1542aef32 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:16.072899 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6a7356f1-3417-4890-88b1-63a1542aef32 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:16.073435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6a7356f1-3417-4890-88b1-63a1542aef32 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:16.074558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6a7356f1-3417-4890-88b1-63a1542aef32 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:16.075071 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6a7356f1-3417-4890-88b1-63a1542aef32 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:16.269411 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d0dc4496-378c-437d-bdd2-1da63df54bb9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:16.273748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6a7356f1-3417-4890-88b1-63a1542aef32 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:16.277291 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d0dc4496-378c-437d-bdd2-1da63df54bb9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.244040 Jun 23 10:53:16.278055 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 218/423] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:16 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:16.281754 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6a7356f1-3417-4890-88b1-63a1542aef32 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.224200 Jun 23 10:53:16.282883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 206/424] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:16 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:16.373641 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0c813bcc-b534-4a34-8108-b356c2ea7fbc tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:16.374123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0c813bcc-b534-4a34-8108-b356c2ea7fbc tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:16.381458 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0c813bcc-b534-4a34-8108-b356c2ea7fbc tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:16.381998 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0c813bcc-b534-4a34-8108-b356c2ea7fbc tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:16.382895 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0c813bcc-b534-4a34-8108-b356c2ea7fbc tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:16.383391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0c813bcc-b534-4a34-8108-b356c2ea7fbc tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:16.535398 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0c813bcc-b534-4a34-8108-b356c2ea7fbc tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:16.547419 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0c813bcc-b534-4a34-8108-b356c2ea7fbc tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.180707 Jun 23 10:53:16.548715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 219/425] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:16 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:16.866010 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-c55826f2-9dfb-4cf2-be7f-7f52c59cb75b req-c7b4882f-153f-4b98-9be7-4e0cb094309b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b5388c-79f6-4797-a1b9-98518ed970ee", "tag": "dd66f398-76e8-408c-bd60-d35c977b57e5"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:16.879980 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-c55826f2-9dfb-4cf2-be7f-7f52c59cb75b req-c7b4882f-153f-4b98-9be7-4e0cb094309b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:16.880658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-c55826f2-9dfb-4cf2-be7f-7f52c59cb75b req-c7b4882f-153f-4b98-9be7-4e0cb094309b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:16.902506 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-c55826f2-9dfb-4cf2-be7f-7f52c59cb75b req-c7b4882f-153f-4b98-9be7-4e0cb094309b service nova] Creating event network-changed:dd66f398-76e8-408c-bd60-d35c977b57e5 for instance b0b5388c-79f6-4797-a1b9-98518ed970ee on hv-cinder-84614 Jun 23 10:53:16.909737 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-c55826f2-9dfb-4cf2-be7f-7f52c59cb75b req-c7b4882f-153f-4b98-9be7-4e0cb094309b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047633 Jun 23 10:53:16.910567 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 207/426] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:17.299991 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c98f1329-ed4c-4e52-9899-f60bdbdf770a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:17.300606 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c98f1329-ed4c-4e52-9899-f60bdbdf770a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:17.302573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5d7aa6c3-253d-4f7e-b839-80639143e27a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:17.303274 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5d7aa6c3-253d-4f7e-b839-80639143e27a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:17.306972 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c98f1329-ed4c-4e52-9899-f60bdbdf770a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:17.307404 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c98f1329-ed4c-4e52-9899-f60bdbdf770a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:17.308166 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c98f1329-ed4c-4e52-9899-f60bdbdf770a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:17.308599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c98f1329-ed4c-4e52-9899-f60bdbdf770a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:17.309762 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5d7aa6c3-253d-4f7e-b839-80639143e27a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:17.310205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5d7aa6c3-253d-4f7e-b839-80639143e27a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:17.310985 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5d7aa6c3-253d-4f7e-b839-80639143e27a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:17.311419 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5d7aa6c3-253d-4f7e-b839-80639143e27a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:17.331900 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:17.514140 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c98f1329-ed4c-4e52-9899-f60bdbdf770a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:17.525448 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5d7aa6c3-253d-4f7e-b839-80639143e27a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:17.534607 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5d7aa6c3-253d-4f7e-b839-80639143e27a tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.235607 Jun 23 10:53:17.535525 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 208/427] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:17 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:17.544898 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c98f1329-ed4c-4e52-9899-f60bdbdf770a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1358 microversion: 2.1 time: 0.251918 Jun 23 10:53:17.546358 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 220/428] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:17 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:17.566173 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d29394a4-6a0d-46fb-8e31-e0629c6a0a84 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:17.567080 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d29394a4-6a0d-46fb-8e31-e0629c6a0a84 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:17.573523 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d29394a4-6a0d-46fb-8e31-e0629c6a0a84 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:17.574448 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d29394a4-6a0d-46fb-8e31-e0629c6a0a84 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:17.575300 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d29394a4-6a0d-46fb-8e31-e0629c6a0a84 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:17.575804 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d29394a4-6a0d-46fb-8e31-e0629c6a0a84 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:17.954122 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d29394a4-6a0d-46fb-8e31-e0629c6a0a84 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:17.961611 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d29394a4-6a0d-46fb-8e31-e0629c6a0a84 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.400632 Jun 23 10:53:17.962175 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 209/429] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:17 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:18.552947 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8dd45bc4-a51b-476c-a2c7-8caaf58e5422 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:18.553553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8dd45bc4-a51b-476c-a2c7-8caaf58e5422 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:18.560902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8dd45bc4-a51b-476c-a2c7-8caaf58e5422 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:18.563991 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8dd45bc4-a51b-476c-a2c7-8caaf58e5422 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:18.563991 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8dd45bc4-a51b-476c-a2c7-8caaf58e5422 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:18.563991 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8dd45bc4-a51b-476c-a2c7-8caaf58e5422 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:18.564314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-cdaccf03-d604-4bcd-863d-6e7a17f6c517 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:18.566207 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-cdaccf03-d604-4bcd-863d-6e7a17f6c517 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:18.569241 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=4 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:18.574891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cdaccf03-d604-4bcd-863d-6e7a17f6c517 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:18.575713 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cdaccf03-d604-4bcd-863d-6e7a17f6c517 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:18.576111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cdaccf03-d604-4bcd-863d-6e7a17f6c517 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:18.576542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cdaccf03-d604-4bcd-863d-6e7a17f6c517 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:18.774873 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8dd45bc4-a51b-476c-a2c7-8caaf58e5422 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:18.783043 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8dd45bc4-a51b-476c-a2c7-8caaf58e5422 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.234633 Jun 23 10:53:18.783606 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 221/430] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:18 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:18.794070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cdaccf03-d604-4bcd-863d-6e7a17f6c517 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:18.802888 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-cdaccf03-d604-4bcd-863d-6e7a17f6c517 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1548 microversion: 2.1 time: 0.243762 Jun 23 10:53:18.803489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 210/431] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:18 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1548 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:18.819566 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7d5cf8d3-5f46-4da2-87bd-a57ad75a684e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:18.820210 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7d5cf8d3-5f46-4da2-87bd-a57ad75a684e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:18.828390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7d5cf8d3-5f46-4da2-87bd-a57ad75a684e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:18.829537 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7d5cf8d3-5f46-4da2-87bd-a57ad75a684e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:18.830476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7d5cf8d3-5f46-4da2-87bd-a57ad75a684e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:18.830985 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7d5cf8d3-5f46-4da2-87bd-a57ad75a684e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:18.971993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7d5cf8d3-5f46-4da2-87bd-a57ad75a684e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:18.978148 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-28bdf642-b34d-4721-8525-41cdacdf552d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:18.978996 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-28bdf642-b34d-4721-8525-41cdacdf552d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:18.979802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7d5cf8d3-5f46-4da2-87bd-a57ad75a684e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1548 microversion: 2.1 time: 0.164099 Jun 23 10:53:18.980314 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 222/432] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:18 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:18.994817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-28bdf642-b34d-4721-8525-41cdacdf552d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:18.995719 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-28bdf642-b34d-4721-8525-41cdacdf552d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:18.996699 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-909f4eb6-5195-4ec3-906d-d988639bb683 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:18.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-28bdf642-b34d-4721-8525-41cdacdf552d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:18.997219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-28bdf642-b34d-4721-8525-41cdacdf552d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:19.002028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-909f4eb6-5195-4ec3-906d-d988639bb683 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:19.002925 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-909f4eb6-5195-4ec3-906d-d988639bb683 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Searching by: {'deleted': False, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6'} {{(pid=129460) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 10:53:19.009703 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-909f4eb6-5195-4ec3-906d-d988639bb683 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:19.010221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-909f4eb6-5195-4ec3-906d-d988639bb683 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:19.011139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-909f4eb6-5195-4ec3-906d-d988639bb683 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:19.011882 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-909f4eb6-5195-4ec3-906d-d988639bb683 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:19.105028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.multi_cell_list [None req-909f4eb6-5195-4ec3-906d-d988639bb683 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129460) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 10:53:19.152666 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-28bdf642-b34d-4721-8525-41cdacdf552d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:19.167341 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-28bdf642-b34d-4721-8525-41cdacdf552d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.192846 Jun 23 10:53:19.168880 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 211/433] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:18 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:19.207107 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-909f4eb6-5195-4ec3-906d-d988639bb683 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214475 Jun 23 10:53:19.207689 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 223/434] 10.222.0.39 () {58 vars in 1124 bytes} [Thu Jun 23 10:53:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:19.219051 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-903cfbe8-74ae-465a-9a21-54657f7c9b30 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:19.220574 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-903cfbe8-74ae-465a-9a21-54657f7c9b30 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:19.227818 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-903cfbe8-74ae-465a-9a21-54657f7c9b30 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:19.228262 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-903cfbe8-74ae-465a-9a21-54657f7c9b30 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:19.229233 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-903cfbe8-74ae-465a-9a21-54657f7c9b30 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:19.229666 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-903cfbe8-74ae-465a-9a21-54657f7c9b30 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:19.408607 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-903cfbe8-74ae-465a-9a21-54657f7c9b30 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:19.416202 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-903cfbe8-74ae-465a-9a21-54657f7c9b30 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1548 microversion: 2.1 time: 0.201509 Jun 23 10:53:19.416761 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 212/435] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:19 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1548 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:19.803239 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-abb315e2-c4f8-431a-afb7-1d2938b06187 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:19.803840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-abb315e2-c4f8-431a-afb7-1d2938b06187 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:19.809953 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abb315e2-c4f8-431a-afb7-1d2938b06187 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:19.810532 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abb315e2-c4f8-431a-afb7-1d2938b06187 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:19.811586 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abb315e2-c4f8-431a-afb7-1d2938b06187 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:19.812129 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abb315e2-c4f8-431a-afb7-1d2938b06187 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:19.955413 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-abb315e2-c4f8-431a-afb7-1d2938b06187 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:19.963022 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-abb315e2-c4f8-431a-afb7-1d2938b06187 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.163540 Jun 23 10:53:19.963588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 224/436] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:19 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:20.185092 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-defa8178-e2ee-4b3a-bf48-79e779b3612e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:20.185698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-defa8178-e2ee-4b3a-bf48-79e779b3612e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:20.191985 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-defa8178-e2ee-4b3a-bf48-79e779b3612e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:20.192430 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-defa8178-e2ee-4b3a-bf48-79e779b3612e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:20.193191 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-defa8178-e2ee-4b3a-bf48-79e779b3612e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:20.193624 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-defa8178-e2ee-4b3a-bf48-79e779b3612e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:20.330291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-defa8178-e2ee-4b3a-bf48-79e779b3612e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:20.338591 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-defa8178-e2ee-4b3a-bf48-79e779b3612e tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.157369 Jun 23 10:53:20.339165 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 213/437] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:20 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:20.981016 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fed1be77-07ee-44a4-aa5c-e78f32bdeb53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:20.981492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fed1be77-07ee-44a4-aa5c-e78f32bdeb53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:20.984142 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=12 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:20.991843 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fed1be77-07ee-44a4-aa5c-e78f32bdeb53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:20.992682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fed1be77-07ee-44a4-aa5c-e78f32bdeb53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:20.993640 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fed1be77-07ee-44a4-aa5c-e78f32bdeb53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:20.994510 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fed1be77-07ee-44a4-aa5c-e78f32bdeb53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:21.029802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-006e98d5-5ca2-4ff2-a9bc-f113e6eb88e7 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30a99c7a-697c-41e6-aad7-3a02f5e46881"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:21.031252 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-006e98d5-5ca2-4ff2-a9bc-f113e6eb88e7 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:21.046470 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-006e98d5-5ca2-4ff2-a9bc-f113e6eb88e7 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:21.046919 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-006e98d5-5ca2-4ff2-a9bc-f113e6eb88e7 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:21.048292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-006e98d5-5ca2-4ff2-a9bc-f113e6eb88e7 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:21.048721 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-006e98d5-5ca2-4ff2-a9bc-f113e6eb88e7 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:21.149174 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fed1be77-07ee-44a4-aa5c-e78f32bdeb53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:21.156940 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fed1be77-07ee-44a4-aa5c-e78f32bdeb53 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.179923 Jun 23 10:53:21.157855 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 225/438] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:20 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:21.356027 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-62c19c9f-d64d-4c38-ae24-4f4fef620d6f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:21.356623 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-62c19c9f-d64d-4c38-ae24-4f4fef620d6f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:21.363290 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62c19c9f-d64d-4c38-ae24-4f4fef620d6f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:21.363725 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62c19c9f-d64d-4c38-ae24-4f4fef620d6f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:21.364476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62c19c9f-d64d-4c38-ae24-4f4fef620d6f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:21.364899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-62c19c9f-d64d-4c38-ae24-4f4fef620d6f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:21.497267 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-62c19c9f-d64d-4c38-ae24-4f4fef620d6f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:21.506421 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-62c19c9f-d64d-4c38-ae24-4f4fef620d6f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.154124 Jun 23 10:53:21.506996 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 226/439] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:21 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:22.142505 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-482628450", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:22.191954 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.network.neutron [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] validate_networks() for None {{(pid=129460) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:53:22.478648 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Flavor limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:53:22.479077 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Image limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:53:22.479548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Flavor pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:53:22.479958 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Image pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:53:22.480364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:53:22.490636 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:22.491071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:22.491974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:22.492434 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:22.511504 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Getting quotas for project 239b2eb649884802b59347962a7bfa88. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:53:22.516374 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Getting quotas for user c1b116b882c141f29eef749cd9a8a5ea and project 239b2eb649884802b59347962a7bfa88. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:53:22.530371 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Going to run 1 instances... {{(pid=129460) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:53:22.533363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129460) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:53:22.554139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:22.585251 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-820d20d2-5836-45bc-a08b-fa43a007f08e tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.447267 Jun 23 10:53:22.590839 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 227/440] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:53:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 10:53:22.591414 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4e6e0569-0b95-4293-88ca-2c29a89a0803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:22.592021 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4e6e0569-0b95-4293-88ca-2c29a89a0803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:22.599682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e6e0569-0b95-4293-88ca-2c29a89a0803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:22.599682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e6e0569-0b95-4293-88ca-2c29a89a0803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:22.600477 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e6e0569-0b95-4293-88ca-2c29a89a0803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:22.600968 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e6e0569-0b95-4293-88ca-2c29a89a0803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:22.781270 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4e6e0569-0b95-4293-88ca-2c29a89a0803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:22.792759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4e6e0569-0b95-4293-88ca-2c29a89a0803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.205298 Jun 23 10:53:22.793592 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 228/441] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:22 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:22.799221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-52138c92-ad65-4097-bd08-1687b7228d26 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:22.800138 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-52138c92-ad65-4097-bd08-1687b7228d26 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:22.808630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-52138c92-ad65-4097-bd08-1687b7228d26 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:22.809304 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-52138c92-ad65-4097-bd08-1687b7228d26 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:22.810363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-52138c92-ad65-4097-bd08-1687b7228d26 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:22.810858 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-52138c92-ad65-4097-bd08-1687b7228d26 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:22.974096 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-52138c92-ad65-4097-bd08-1687b7228d26 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:22.981571 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-52138c92-ad65-4097-bd08-1687b7228d26 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.186605 Jun 23 10:53:22.982139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 229/442] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:22 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:22.986768 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-818441ec-a8b5-40b5-9930-32dd4bcecc73 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:22.987430 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-818441ec-a8b5-40b5-9930-32dd4bcecc73 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:23.042186 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-818441ec-a8b5-40b5-9930-32dd4bcecc73 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:23.049631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-818441ec-a8b5-40b5-9930-32dd4bcecc73 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1214 microversion: 2.1 time: 0.066225 Jun 23 10:53:23.050218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 230/443] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:22 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:23.811561 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c60fe2a4-e9fd-4ad2-8707-28aa779092ab tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:23.812220 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c60fe2a4-e9fd-4ad2-8707-28aa779092ab tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:23.820406 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c60fe2a4-e9fd-4ad2-8707-28aa779092ab tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:23.820859 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c60fe2a4-e9fd-4ad2-8707-28aa779092ab tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:23.821770 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c60fe2a4-e9fd-4ad2-8707-28aa779092ab tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:23.822216 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c60fe2a4-e9fd-4ad2-8707-28aa779092ab tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:24.008763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c60fe2a4-e9fd-4ad2-8707-28aa779092ab tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:24.017836 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c60fe2a4-e9fd-4ad2-8707-28aa779092ab tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.210582 Jun 23 10:53:24.018447 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 231/444] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:23 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:24.027440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f8c97526-720f-43f9-a9c7-8e27304132d6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:24.028053 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f8c97526-720f-43f9-a9c7-8e27304132d6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:24.034623 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f8c97526-720f-43f9-a9c7-8e27304132d6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:24.035071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f8c97526-720f-43f9-a9c7-8e27304132d6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:24.035848 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f8c97526-720f-43f9-a9c7-8e27304132d6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:24.036333 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f8c97526-720f-43f9-a9c7-8e27304132d6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:24.230097 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f8c97526-720f-43f9-a9c7-8e27304132d6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:24.240621 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f8c97526-720f-43f9-a9c7-8e27304132d6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.216863 Jun 23 10:53:24.243861 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 232/445] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:24 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:24.255484 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b75f9d63-c2ad-43fa-b594-08fa57f4bdcf tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:24.256238 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b75f9d63-c2ad-43fa-b594-08fa57f4bdcf tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:24.262848 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b75f9d63-c2ad-43fa-b594-08fa57f4bdcf tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:24.263293 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b75f9d63-c2ad-43fa-b594-08fa57f4bdcf tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:24.264049 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b75f9d63-c2ad-43fa-b594-08fa57f4bdcf tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:24.264473 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b75f9d63-c2ad-43fa-b594-08fa57f4bdcf tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:24.323079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-006e98d5-5ca2-4ff2-a9bc-f113e6eb88e7 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "POST /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.297212 Jun 23 10:53:24.324015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 214/446] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 10:53:21 2022] POST /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments => generated 194 bytes in 3299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:53:24.341401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b75f9d63-c2ad-43fa-b594-08fa57f4bdcf tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:24.350515 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b75f9d63-c2ad-43fa-b594-08fa57f4bdcf tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1210 microversion: 2.1 time: 0.107460 Jun 23 10:53:24.351711 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 233/447] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:24 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:24.706649 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-e8a3288b-be91-4839-ac65-cbadba542ce7 req-d493f1a4-7415-43dc-8c45-defde611466a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed60172-efba-4ed3-8e82-3ef05bf9522e", "name": "network-vif-plugged", "status": "completed", "tag": "e8e9378e-1b9a-47cc-a47e-7c4206ca14c4"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:24.716356 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-e8a3288b-be91-4839-ac65-cbadba542ce7 req-d493f1a4-7415-43dc-8c45-defde611466a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:24.717107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-e8a3288b-be91-4839-ac65-cbadba542ce7 req-d493f1a4-7415-43dc-8c45-defde611466a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:24.729278 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-e8a3288b-be91-4839-ac65-cbadba542ce7 req-d493f1a4-7415-43dc-8c45-defde611466a service nova] Creating event network-vif-plugged:e8e9378e-1b9a-47cc-a47e-7c4206ca14c4 for instance 3ed60172-efba-4ed3-8e82-3ef05bf9522e on hv-cinder-84614 Jun 23 10:53:24.734204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-e8a3288b-be91-4839-ac65-cbadba542ce7 req-d493f1a4-7415-43dc-8c45-defde611466a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032137 Jun 23 10:53:24.734817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 215/448] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:25.036176 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-262e4c2c-70b8-4a1f-917e-379229d6cc8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:25.036789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-262e4c2c-70b8-4a1f-917e-379229d6cc8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:25.052552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-262e4c2c-70b8-4a1f-917e-379229d6cc8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:25.053012 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-262e4c2c-70b8-4a1f-917e-379229d6cc8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:25.053854 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-262e4c2c-70b8-4a1f-917e-379229d6cc8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:25.054290 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-262e4c2c-70b8-4a1f-917e-379229d6cc8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:25.215118 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-262e4c2c-70b8-4a1f-917e-379229d6cc8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:25.224035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-262e4c2c-70b8-4a1f-917e-379229d6cc8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.193015 Jun 23 10:53:25.224908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 234/449] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:25 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:25.259453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-34ceebf6-a459-4a66-8748-4196088bbfad tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:25.260431 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-34ceebf6-a459-4a66-8748-4196088bbfad tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:25.268440 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-34ceebf6-a459-4a66-8748-4196088bbfad tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:25.269186 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-34ceebf6-a459-4a66-8748-4196088bbfad tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:25.269892 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-34ceebf6-a459-4a66-8748-4196088bbfad tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:25.270339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-34ceebf6-a459-4a66-8748-4196088bbfad tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:25.369782 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4a2d2d09-949f-4be1-97b6-5ec1b9f4c4f1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:25.370779 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4a2d2d09-949f-4be1-97b6-5ec1b9f4c4f1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:25.379017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a2d2d09-949f-4be1-97b6-5ec1b9f4c4f1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:25.379899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a2d2d09-949f-4be1-97b6-5ec1b9f4c4f1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:25.380867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a2d2d09-949f-4be1-97b6-5ec1b9f4c4f1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:25.381559 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a2d2d09-949f-4be1-97b6-5ec1b9f4c4f1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:25.416937 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-34ceebf6-a459-4a66-8748-4196088bbfad tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:25.425319 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-34ceebf6-a459-4a66-8748-4196088bbfad tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.170543 Jun 23 10:53:25.426286 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 216/450] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:25 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:25.483286 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4a2d2d09-949f-4be1-97b6-5ec1b9f4c4f1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:25.491625 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4a2d2d09-949f-4be1-97b6-5ec1b9f4c4f1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1272 microversion: 2.1 time: 0.126147 Jun 23 10:53:25.492165 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 235/451] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:25 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:26.242371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7923df42-e87e-44c7-b1bb-021bbf6e53ae tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:26.242980 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7923df42-e87e-44c7-b1bb-021bbf6e53ae tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:26.249623 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7923df42-e87e-44c7-b1bb-021bbf6e53ae tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:26.250060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7923df42-e87e-44c7-b1bb-021bbf6e53ae tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:26.250843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7923df42-e87e-44c7-b1bb-021bbf6e53ae tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:26.251271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7923df42-e87e-44c7-b1bb-021bbf6e53ae tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:26.380611 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7923df42-e87e-44c7-b1bb-021bbf6e53ae tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:26.387893 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7923df42-e87e-44c7-b1bb-021bbf6e53ae tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.151770 Jun 23 10:53:26.388446 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 217/452] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:26 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:26.442402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ac8acd6b-f288-4d99-87c4-8bf710f0dceb tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:26.443007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ac8acd6b-f288-4d99-87c4-8bf710f0dceb tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:26.449247 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ac8acd6b-f288-4d99-87c4-8bf710f0dceb tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:26.449682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ac8acd6b-f288-4d99-87c4-8bf710f0dceb tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:26.450550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ac8acd6b-f288-4d99-87c4-8bf710f0dceb tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:26.450976 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ac8acd6b-f288-4d99-87c4-8bf710f0dceb tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:26.508669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e4eed77b-8fc7-462d-94d4-5f92b2ac5d02 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:26.509496 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e4eed77b-8fc7-462d-94d4-5f92b2ac5d02 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:26.515327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4eed77b-8fc7-462d-94d4-5f92b2ac5d02 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:26.515761 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4eed77b-8fc7-462d-94d4-5f92b2ac5d02 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:26.516735 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4eed77b-8fc7-462d-94d4-5f92b2ac5d02 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:26.517321 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4eed77b-8fc7-462d-94d4-5f92b2ac5d02 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:26.644266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ac8acd6b-f288-4d99-87c4-8bf710f0dceb tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:26.655358 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ac8acd6b-f288-4d99-87c4-8bf710f0dceb tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1314 microversion: 2.1 time: 0.216274 Jun 23 10:53:26.657083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 236/453] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:26 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:26.695686 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e4eed77b-8fc7-462d-94d4-5f92b2ac5d02 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:26.705452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e4eed77b-8fc7-462d-94d4-5f92b2ac5d02 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.200487 Jun 23 10:53:26.706821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 218/454] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:26 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:27.203577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-63f9c2b7-0553-4a7b-952c-6b946097db8a req-7bca7bd3-b832-4f99-aba1-8642c273f083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12221dfe-8cb3-4716-892b-dcc15010c922", "tag": "00f19225-fa8c-4963-900a-11b7c2ab039d"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:27.213348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-63f9c2b7-0553-4a7b-952c-6b946097db8a req-7bca7bd3-b832-4f99-aba1-8642c273f083 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:27.213793 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-63f9c2b7-0553-4a7b-952c-6b946097db8a req-7bca7bd3-b832-4f99-aba1-8642c273f083 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:27.230835 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-63f9c2b7-0553-4a7b-952c-6b946097db8a req-7bca7bd3-b832-4f99-aba1-8642c273f083 service nova] Creating event network-changed:00f19225-fa8c-4963-900a-11b7c2ab039d for instance 12221dfe-8cb3-4716-892b-dcc15010c922 on hv-cinder-84614 Jun 23 10:53:27.235953 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-63f9c2b7-0553-4a7b-952c-6b946097db8a req-7bca7bd3-b832-4f99-aba1-8642c273f083 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036185 Jun 23 10:53:27.238523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 237/455] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:53:27.404894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f8995060-96cf-4f30-a4da-ab3d338b5f7c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:27.405500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f8995060-96cf-4f30-a4da-ab3d338b5f7c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:27.412776 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f8995060-96cf-4f30-a4da-ab3d338b5f7c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:27.413225 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f8995060-96cf-4f30-a4da-ab3d338b5f7c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:27.413997 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f8995060-96cf-4f30-a4da-ab3d338b5f7c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:27.414466 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f8995060-96cf-4f30-a4da-ab3d338b5f7c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:27.429860 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:27.549367 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f8995060-96cf-4f30-a4da-ab3d338b5f7c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:27.557034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f8995060-96cf-4f30-a4da-ab3d338b5f7c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.155964 Jun 23 10:53:27.557595 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 219/456] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:27 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:27.673485 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f032c5de-76af-47c7-b6ad-713f5df6ea1d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:27.674957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f032c5de-76af-47c7-b6ad-713f5df6ea1d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:27.681137 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f032c5de-76af-47c7-b6ad-713f5df6ea1d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:27.681519 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f032c5de-76af-47c7-b6ad-713f5df6ea1d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:27.682268 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f032c5de-76af-47c7-b6ad-713f5df6ea1d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:27.682720 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f032c5de-76af-47c7-b6ad-713f5df6ea1d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:27.724267 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-48235d92-7de0-48eb-a125-ccb2ba3d249d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:27.724890 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-48235d92-7de0-48eb-a125-ccb2ba3d249d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:27.730879 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-48235d92-7de0-48eb-a125-ccb2ba3d249d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:27.731323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-48235d92-7de0-48eb-a125-ccb2ba3d249d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:27.732094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-48235d92-7de0-48eb-a125-ccb2ba3d249d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:27.732526 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-48235d92-7de0-48eb-a125-ccb2ba3d249d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:27.873578 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f032c5de-76af-47c7-b6ad-713f5df6ea1d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:27.884611 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f032c5de-76af-47c7-b6ad-713f5df6ea1d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1498 microversion: 2.1 time: 0.215341 Jun 23 10:53:27.885175 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 238/457] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:27 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1498 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:27.899114 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-48235d92-7de0-48eb-a125-ccb2ba3d249d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:27.907376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-48235d92-7de0-48eb-a125-ccb2ba3d249d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.188035 Jun 23 10:53:27.908022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 220/458] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:27 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:28.495530 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2f272aba-64b8-4b9c-bfa5-002a864f0f56 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:28.496020 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2f272aba-64b8-4b9c-bfa5-002a864f0f56 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:28.501962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f272aba-64b8-4b9c-bfa5-002a864f0f56 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:28.502446 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f272aba-64b8-4b9c-bfa5-002a864f0f56 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:28.503207 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f272aba-64b8-4b9c-bfa5-002a864f0f56 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:28.503638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f272aba-64b8-4b9c-bfa5-002a864f0f56 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:28.506273 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:28.531000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2f272aba-64b8-4b9c-bfa5-002a864f0f56 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:53:28.574804 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2f6ff2df-71fe-4fda-ac4f-d34f228cefe6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:28.576456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2f6ff2df-71fe-4fda-ac4f-d34f228cefe6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:28.583795 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f6ff2df-71fe-4fda-ac4f-d34f228cefe6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:28.584249 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f6ff2df-71fe-4fda-ac4f-d34f228cefe6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:28.585194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f6ff2df-71fe-4fda-ac4f-d34f228cefe6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:28.585633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f6ff2df-71fe-4fda-ac4f-d34f228cefe6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:28.618310 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2f272aba-64b8-4b9c-bfa5-002a864f0f56 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 204 len: 0 microversion: 2.1 time: 0.126229 Jun 23 10:53:28.619168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 239/459] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:53:28 2022] DELETE /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:53:28.628345 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c569c94a-41bd-4ddb-8cbc-ea33a4c93519 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:28.629135 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c569c94a-41bd-4ddb-8cbc-ea33a4c93519 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:28.635123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c569c94a-41bd-4ddb-8cbc-ea33a4c93519 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:28.635889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c569c94a-41bd-4ddb-8cbc-ea33a4c93519 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:28.636771 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c569c94a-41bd-4ddb-8cbc-ea33a4c93519 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:28.637468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c569c94a-41bd-4ddb-8cbc-ea33a4c93519 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:28.863472 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c569c94a-41bd-4ddb-8cbc-ea33a4c93519 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:28.870496 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2f6ff2df-71fe-4fda-ac4f-d34f228cefe6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:28.878356 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c569c94a-41bd-4ddb-8cbc-ea33a4c93519 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1504 microversion: 2.1 time: 0.254532 Jun 23 10:53:28.879303 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2f6ff2df-71fe-4fda-ac4f-d34f228cefe6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.308716 Jun 23 10:53:28.879506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 240/460] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:28 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:28.880140 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 221/461] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:28 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:28.884098 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-14697262-a84f-43bb-9cd9-06aa932bb44a req-f8be9cb5-db9a-45cc-b8a3-c521e15cd900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b5388c-79f6-4797-a1b9-98518ed970ee", "name": "network-vif-plugged", "status": "completed", "tag": "dd66f398-76e8-408c-bd60-d35c977b57e5"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:28.892380 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-14697262-a84f-43bb-9cd9-06aa932bb44a req-f8be9cb5-db9a-45cc-b8a3-c521e15cd900 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:28.893601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-14697262-a84f-43bb-9cd9-06aa932bb44a req-f8be9cb5-db9a-45cc-b8a3-c521e15cd900 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:28.907961 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-14697262-a84f-43bb-9cd9-06aa932bb44a req-f8be9cb5-db9a-45cc-b8a3-c521e15cd900 service nova] Creating event network-vif-plugged:dd66f398-76e8-408c-bd60-d35c977b57e5 for instance b0b5388c-79f6-4797-a1b9-98518ed970ee on hv-cinder-84614 Jun 23 10:53:28.913789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-14697262-a84f-43bb-9cd9-06aa932bb44a req-f8be9cb5-db9a-45cc-b8a3-c521e15cd900 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033146 Jun 23 10:53:28.914400 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 241/462] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:28.924941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f5dde98b-1ce5-43dc-beb8-8c90b4f8bf61 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:28.924941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f5dde98b-1ce5-43dc-beb8-8c90b4f8bf61 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:28.930876 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f5dde98b-1ce5-43dc-beb8-8c90b4f8bf61 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:28.931322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f5dde98b-1ce5-43dc-beb8-8c90b4f8bf61 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:28.932081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f5dde98b-1ce5-43dc-beb8-8c90b4f8bf61 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:28.932511 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f5dde98b-1ce5-43dc-beb8-8c90b4f8bf61 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:29.060456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f5dde98b-1ce5-43dc-beb8-8c90b4f8bf61 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:29.067991 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f5dde98b-1ce5-43dc-beb8-8c90b4f8bf61 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.148330 Jun 23 10:53:29.068546 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 222/463] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:28 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:29.896754 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a7cb44be-c119-4f64-9ad7-24cad8acbfdf tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:29.897330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-eab5a745-29ff-42ec-ae4d-4f924dccaf9e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:29.897700 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-eab5a745-29ff-42ec-ae4d-4f924dccaf9e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:29.897823 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a7cb44be-c119-4f64-9ad7-24cad8acbfdf tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:29.903684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a7cb44be-c119-4f64-9ad7-24cad8acbfdf tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:29.903827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eab5a745-29ff-42ec-ae4d-4f924dccaf9e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:29.904122 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a7cb44be-c119-4f64-9ad7-24cad8acbfdf tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:29.904278 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eab5a745-29ff-42ec-ae4d-4f924dccaf9e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:29.904872 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a7cb44be-c119-4f64-9ad7-24cad8acbfdf tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:29.905014 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eab5a745-29ff-42ec-ae4d-4f924dccaf9e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:29.905295 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a7cb44be-c119-4f64-9ad7-24cad8acbfdf tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:29.905450 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eab5a745-29ff-42ec-ae4d-4f924dccaf9e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:30.107652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a7cb44be-c119-4f64-9ad7-24cad8acbfdf tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:30.112003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-eab5a745-29ff-42ec-ae4d-4f924dccaf9e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:30.115548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a7cb44be-c119-4f64-9ad7-24cad8acbfdf tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1504 microversion: 2.1 time: 0.223530 Jun 23 10:53:30.116108 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 242/464] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:29 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:30.119184 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-eab5a745-29ff-42ec-ae4d-4f924dccaf9e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.226790 Jun 23 10:53:30.119729 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 223/465] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:29 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:30.120438 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fbb03b13-dd6c-430f-85ab-ee357093a2c1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:30.121031 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fbb03b13-dd6c-430f-85ab-ee357093a2c1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:30.128380 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fbb03b13-dd6c-430f-85ab-ee357093a2c1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:30.128824 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fbb03b13-dd6c-430f-85ab-ee357093a2c1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:30.129600 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fbb03b13-dd6c-430f-85ab-ee357093a2c1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:30.129999 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fbb03b13-dd6c-430f-85ab-ee357093a2c1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:30.261612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fbb03b13-dd6c-430f-85ab-ee357093a2c1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:30.269551 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fbb03b13-dd6c-430f-85ab-ee357093a2c1 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.152524 Jun 23 10:53:30.270101 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 243/466] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:30 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:31.133189 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e2ee41f9-7ff7-42e8-8693-2cccde91d9c8 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:31.133800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e2ee41f9-7ff7-42e8-8693-2cccde91d9c8 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:31.136432 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-54344b9e-cede-43d6-a190-7ed5c060db01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:31.137045 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-54344b9e-cede-43d6-a190-7ed5c060db01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:31.140407 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e2ee41f9-7ff7-42e8-8693-2cccde91d9c8 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:31.140851 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e2ee41f9-7ff7-42e8-8693-2cccde91d9c8 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:31.141613 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e2ee41f9-7ff7-42e8-8693-2cccde91d9c8 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:31.142042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e2ee41f9-7ff7-42e8-8693-2cccde91d9c8 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:31.143734 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-54344b9e-cede-43d6-a190-7ed5c060db01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:31.144285 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-54344b9e-cede-43d6-a190-7ed5c060db01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:31.145186 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-54344b9e-cede-43d6-a190-7ed5c060db01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:31.145485 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-54344b9e-cede-43d6-a190-7ed5c060db01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:31.333190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-54344b9e-cede-43d6-a190-7ed5c060db01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:31.337377 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e2ee41f9-7ff7-42e8-8693-2cccde91d9c8 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:31.340822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-54344b9e-cede-43d6-a190-7ed5c060db01 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.208092 Jun 23 10:53:31.341395 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 244/467] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:31 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:31.345542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e2ee41f9-7ff7-42e8-8693-2cccde91d9c8 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1504 microversion: 2.1 time: 0.216222 Jun 23 10:53:31.346608 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3d474a80-afda-49f5-82df-8aecc4d22759 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:31.347310 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3d474a80-afda-49f5-82df-8aecc4d22759 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:31.347844 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 224/468] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:31 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:31.354099 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3d474a80-afda-49f5-82df-8aecc4d22759 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:31.354877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3d474a80-afda-49f5-82df-8aecc4d22759 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:31.355642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3d474a80-afda-49f5-82df-8aecc4d22759 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:31.356076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3d474a80-afda-49f5-82df-8aecc4d22759 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:31.483570 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3d474a80-afda-49f5-82df-8aecc4d22759 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:31.491015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3d474a80-afda-49f5-82df-8aecc4d22759 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.148546 Jun 23 10:53:31.491558 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 245/469] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:31 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:32.358115 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3f10ea59-b4da-496f-b8ae-84028a9484cd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:32.359890 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3f10ea59-b4da-496f-b8ae-84028a9484cd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:32.363025 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:32.364340 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7f33f677-b433-49a6-8ccf-9529c007e846 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:32.365030 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7f33f677-b433-49a6-8ccf-9529c007e846 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:32.369087 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3f10ea59-b4da-496f-b8ae-84028a9484cd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:32.369473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3f10ea59-b4da-496f-b8ae-84028a9484cd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:32.370227 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3f10ea59-b4da-496f-b8ae-84028a9484cd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:32.370688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3f10ea59-b4da-496f-b8ae-84028a9484cd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:32.370897 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7f33f677-b433-49a6-8ccf-9529c007e846 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:32.371437 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7f33f677-b433-49a6-8ccf-9529c007e846 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:32.372548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7f33f677-b433-49a6-8ccf-9529c007e846 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:32.373078 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7f33f677-b433-49a6-8ccf-9529c007e846 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:32.499610 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=6 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:32.564131 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3f10ea59-b4da-496f-b8ae-84028a9484cd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:32.571453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3f10ea59-b4da-496f-b8ae-84028a9484cd tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.217164 Jun 23 10:53:32.572015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 225/470] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:32 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:32.576662 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-82310715-5a4f-4e4a-838f-fb9811c6a08c tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:32.576971 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7f33f677-b433-49a6-8ccf-9529c007e846 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:32.577255 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-82310715-5a4f-4e4a-838f-fb9811c6a08c tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:32.583694 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82310715-5a4f-4e4a-838f-fb9811c6a08c tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:32.584187 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82310715-5a4f-4e4a-838f-fb9811c6a08c tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:32.584946 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82310715-5a4f-4e4a-838f-fb9811c6a08c tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:32.585375 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82310715-5a4f-4e4a-838f-fb9811c6a08c tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:32.588448 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7f33f677-b433-49a6-8ccf-9529c007e846 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1504 microversion: 2.1 time: 0.228476 Jun 23 10:53:32.589020 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 246/471] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:32 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:32.712178 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-82310715-5a4f-4e4a-838f-fb9811c6a08c tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:32.719613 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-82310715-5a4f-4e4a-838f-fb9811c6a08c tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.146661 Jun 23 10:53:32.720169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 226/472] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:32 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:33.589064 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-933353cc-5e23-4bd7-a99d-bcb2835ea853 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:33.589642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-933353cc-5e23-4bd7-a99d-bcb2835ea853 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:33.591460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=8 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:33.597628 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-933353cc-5e23-4bd7-a99d-bcb2835ea853 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:33.598063 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-933353cc-5e23-4bd7-a99d-bcb2835ea853 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:33.598836 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-933353cc-5e23-4bd7-a99d-bcb2835ea853 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:33.599267 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-933353cc-5e23-4bd7-a99d-bcb2835ea853 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:33.604675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a087b2ec-2a51-4fd0-8639-930721d1195b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:33.605379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a087b2ec-2a51-4fd0-8639-930721d1195b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:33.612467 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a087b2ec-2a51-4fd0-8639-930721d1195b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:33.613001 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a087b2ec-2a51-4fd0-8639-930721d1195b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:33.613761 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a087b2ec-2a51-4fd0-8639-930721d1195b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:33.614191 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a087b2ec-2a51-4fd0-8639-930721d1195b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:33.784797 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-933353cc-5e23-4bd7-a99d-bcb2835ea853 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:33.792169 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-933353cc-5e23-4bd7-a99d-bcb2835ea853 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.207006 Jun 23 10:53:33.792731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 247/473] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:33 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:33.797054 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8864ec7a-18e2-4e7f-9eb0-2285ae67b911 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:33.797648 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8864ec7a-18e2-4e7f-9eb0-2285ae67b911 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:33.804152 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8864ec7a-18e2-4e7f-9eb0-2285ae67b911 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:33.804596 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8864ec7a-18e2-4e7f-9eb0-2285ae67b911 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:33.805351 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8864ec7a-18e2-4e7f-9eb0-2285ae67b911 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:33.805774 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8864ec7a-18e2-4e7f-9eb0-2285ae67b911 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:33.805873 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a087b2ec-2a51-4fd0-8639-930721d1195b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:33.813273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a087b2ec-2a51-4fd0-8639-930721d1195b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1504 microversion: 2.1 time: 0.212319 Jun 23 10:53:33.813827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 227/474] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:33 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:33.933699 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8864ec7a-18e2-4e7f-9eb0-2285ae67b911 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:33.941681 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8864ec7a-18e2-4e7f-9eb0-2285ae67b911 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.148013 Jun 23 10:53:33.942238 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 248/475] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:33 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:34.809947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-93e29a07-63e3-4547-8f8a-5a15c0de8645 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:34.810501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-93e29a07-63e3-4547-8f8a-5a15c0de8645 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:34.816928 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-93e29a07-63e3-4547-8f8a-5a15c0de8645 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:34.817367 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-93e29a07-63e3-4547-8f8a-5a15c0de8645 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:34.818168 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-93e29a07-63e3-4547-8f8a-5a15c0de8645 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:34.818637 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-93e29a07-63e3-4547-8f8a-5a15c0de8645 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:34.830220 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6a533fca-a9c5-407a-ba50-ade6e05898a9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:34.831391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6a533fca-a9c5-407a-ba50-ade6e05898a9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:34.839152 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6a533fca-a9c5-407a-ba50-ade6e05898a9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:34.839591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6a533fca-a9c5-407a-ba50-ade6e05898a9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:34.840354 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6a533fca-a9c5-407a-ba50-ade6e05898a9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:34.840781 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6a533fca-a9c5-407a-ba50-ade6e05898a9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:35.020439 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-93e29a07-63e3-4547-8f8a-5a15c0de8645 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:35.024250 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6a533fca-a9c5-407a-ba50-ade6e05898a9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:35.027975 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-93e29a07-63e3-4547-8f8a-5a15c0de8645 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.221919 Jun 23 10:53:35.028698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 228/476] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:34 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:35.040088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6a533fca-a9c5-407a-ba50-ade6e05898a9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1504 microversion: 2.1 time: 0.213545 Jun 23 10:53:35.040832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 249/477] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:34 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:35.042253 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8eb0d667-984a-4551-b83c-f7cd6fcfdf8b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:35.042888 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8eb0d667-984a-4551-b83c-f7cd6fcfdf8b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:35.048744 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8eb0d667-984a-4551-b83c-f7cd6fcfdf8b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:35.049190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8eb0d667-984a-4551-b83c-f7cd6fcfdf8b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:35.051139 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8eb0d667-984a-4551-b83c-f7cd6fcfdf8b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:35.051565 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8eb0d667-984a-4551-b83c-f7cd6fcfdf8b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:35.182463 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8eb0d667-984a-4551-b83c-f7cd6fcfdf8b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:35.189714 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8eb0d667-984a-4551-b83c-f7cd6fcfdf8b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.151143 Jun 23 10:53:35.190346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 229/478] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:35 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:35.983788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-20c9efdb-1b47-41a1-85c6-3e570c601384 req-04cac139-8642-49ff-bcea-9e608a8a4b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed60172-efba-4ed3-8e82-3ef05bf9522e", "name": "network-vif-deleted", "tag": "e8e9378e-1b9a-47cc-a47e-7c4206ca14c4"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:35.993129 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-20c9efdb-1b47-41a1-85c6-3e570c601384 req-04cac139-8642-49ff-bcea-9e608a8a4b00 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:35.993570 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-20c9efdb-1b47-41a1-85c6-3e570c601384 req-04cac139-8642-49ff-bcea-9e608a8a4b00 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:36.004678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-20c9efdb-1b47-41a1-85c6-3e570c601384 req-04cac139-8642-49ff-bcea-9e608a8a4b00 service nova] Creating event network-vif-deleted:e8e9378e-1b9a-47cc-a47e-7c4206ca14c4 for instance 3ed60172-efba-4ed3-8e82-3ef05bf9522e on hv-cinder-84614 Jun 23 10:53:36.009876 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-20c9efdb-1b47-41a1-85c6-3e570c601384 req-04cac139-8642-49ff-bcea-9e608a8a4b00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029656 Jun 23 10:53:36.010486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 250/479] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:36.044764 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7c1a7269-9d58-4ac2-8c28-b4cecf282247 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:36.045372 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7c1a7269-9d58-4ac2-8c28-b4cecf282247 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:36.053322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7c1a7269-9d58-4ac2-8c28-b4cecf282247 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:36.053769 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7c1a7269-9d58-4ac2-8c28-b4cecf282247 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:36.054585 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7c1a7269-9d58-4ac2-8c28-b4cecf282247 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:36.055030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7c1a7269-9d58-4ac2-8c28-b4cecf282247 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:36.058584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a2f1c890-9091-47d1-9bec-6c27f269d342 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:36.059305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a2f1c890-9091-47d1-9bec-6c27f269d342 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:36.065601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a2f1c890-9091-47d1-9bec-6c27f269d342 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:36.066128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a2f1c890-9091-47d1-9bec-6c27f269d342 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:36.066923 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a2f1c890-9091-47d1-9bec-6c27f269d342 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:36.067353 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a2f1c890-9091-47d1-9bec-6c27f269d342 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:36.149381 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a2f1c890-9091-47d1-9bec-6c27f269d342 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:36.157307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a2f1c890-9091-47d1-9bec-6c27f269d342 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1462 microversion: 2.1 time: 0.103859 Jun 23 10:53:36.157867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 251/480] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:36 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1462 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:36.207183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a6615031-81ec-47f7-bb60-41c0a22c533b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:36.207788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a6615031-81ec-47f7-bb60-41c0a22c533b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:36.214048 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a6615031-81ec-47f7-bb60-41c0a22c533b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:36.214529 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a6615031-81ec-47f7-bb60-41c0a22c533b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:36.215295 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a6615031-81ec-47f7-bb60-41c0a22c533b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:36.215727 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a6615031-81ec-47f7-bb60-41c0a22c533b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:36.216334 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7c1a7269-9d58-4ac2-8c28-b4cecf282247 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:36.224341 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7c1a7269-9d58-4ac2-8c28-b4cecf282247 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.183348 Jun 23 10:53:36.227006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 230/481] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:36 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:36.370341 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a6615031-81ec-47f7-bb60-41c0a22c533b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:36.380177 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a6615031-81ec-47f7-bb60-41c0a22c533b tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.176546 Jun 23 10:53:36.381184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 252/482] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:36 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:36.808919 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-654492994", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1984337626", "security_groups": [{"name": "tempest-secgroup-smoke-1207352602"}], "block_device_mapping_v2": [{"uuid": "67237f77-0558-4bde-abd2-5ed054cc4233", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d50fe3b-1b55-47cc-8ab0-a390036040cd"}]}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:36.928481 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] validate_networks() for [('7d50fe3b-1b55-47cc-8ab0-a390036040cd', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:53:37.174041 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:37.175670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:37.182294 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.182769 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.183537 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.183973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.215679 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.216375 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.216993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lazy-loading 'fault' on Instance uuid 3ed60172-efba-4ed3-8e82-3ef05bf9522e {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:53:37.283890 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:37.292128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e67dea46-2730-496e-84a6-d82e34a3c70c tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 200 len: 1304 microversion: 2.1 time: 0.121898 Jun 23 10:53:37.292885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 253/483] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:37 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:37.306753 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3fc69cdb-280a-4b6f-b57c-0694eb25c79f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:37.307362 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3fc69cdb-280a-4b6f-b57c-0694eb25c79f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:37.313387 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3fc69cdb-280a-4b6f-b57c-0694eb25c79f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.313837 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3fc69cdb-280a-4b6f-b57c-0694eb25c79f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.314620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3fc69cdb-280a-4b6f-b57c-0694eb25c79f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.315064 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3fc69cdb-280a-4b6f-b57c-0694eb25c79f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.355862 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:53:37.356358 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:53:37.356787 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:53:37.357218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:53:37.357659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:53:37.367679 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.368145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.368970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.369462 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.388421 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Getting quotas for project 79dbb107721b4406b5c3e2f5081034fd. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:53:37.393273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Getting quotas for user 10ae039c34c442f880c51aaf9024db8d and project 79dbb107721b4406b5c3e2f5081034fd. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:53:37.461952 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:53:37.465521 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67237f77-0558-4bde-abd2-5ed054cc4233',volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:53:37.467754 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3fc69cdb-280a-4b6f-b57c-0694eb25c79f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:37.477567 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3fc69cdb-280a-4b6f-b57c-0694eb25c79f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1369 microversion: 2.1 time: 0.174490 Jun 23 10:53:37.478140 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 254/484] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:37 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:37.483132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0904b06d-9801-4933-a3e8-9aeee3147ae4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:37.483957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0904b06d-9801-4933-a3e8-9aeee3147ae4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:37.491368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0904b06d-9801-4933-a3e8-9aeee3147ae4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.491899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0904b06d-9801-4933-a3e8-9aeee3147ae4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.492798 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0904b06d-9801-4933-a3e8-9aeee3147ae4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.493299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0904b06d-9801-4933-a3e8-9aeee3147ae4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.496402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:37.641478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0904b06d-9801-4933-a3e8-9aeee3147ae4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:37.645207 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-281fd2c4-fa9e-4dd8-8d7d-545e5d56a77c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.840311 Jun 23 10:53:37.646718 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 231/485] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:53:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:53:37.651420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0904b06d-9801-4933-a3e8-9aeee3147ae4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1594 microversion: 2.1 time: 0.171894 Jun 23 10:53:37.652965 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8d62fd08-6d67-468a-8b8a-093ecfd487f4 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:37.653629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8d62fd08-6d67-468a-8b8a-093ecfd487f4 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:37.661948 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d62fd08-6d67-468a-8b8a-093ecfd487f4 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.662436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d62fd08-6d67-468a-8b8a-093ecfd487f4 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.663448 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d62fd08-6d67-468a-8b8a-093ecfd487f4 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:37.664219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d62fd08-6d67-468a-8b8a-093ecfd487f4 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:37.664305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 255/486] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:37 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1594 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:37.671274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b00edd40-78aa-4ed0-b96f-13629cd0fe74 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:37.672132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b00edd40-78aa-4ed0-b96f-13629cd0fe74 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:37.778919 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b00edd40-78aa-4ed0-b96f-13629cd0fe74 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:37.789040 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b00edd40-78aa-4ed0-b96f-13629cd0fe74 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1094 microversion: 2.1 time: 0.123678 Jun 23 10:53:37.790720 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 256/487] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:37 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:37.859427 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8d62fd08-6d67-468a-8b8a-093ecfd487f4 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:37.868257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8d62fd08-6d67-468a-8b8a-093ecfd487f4 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.220510 Jun 23 10:53:37.868873 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 232/488] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:37 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:38.311531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:38.312241 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: 3ed60172-efba-4ed3-8e82-3ef05bf9522e] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:38.319139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:38.319730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:38.320530 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:38.321039 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:38.336713 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] HTTP exception thrown: Instance 3ed60172-efba-4ed3-8e82-3ef05bf9522e could not be found. Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Request method failure captured: Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e HTTP/1.1 Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEYGqstZ8x0RtUl6LoGAnAuf_ORNXqg6uxzCre9fErqBssybNMJHR5EFdi0hZbEptdd6_3ktPYGYbO1_nMGgzNmH_P8kqm4OE2XiJBY9HcilEyJ6RkJg5gGzQU_lCvsUah3Ttth-jDfgWoSMxqG8KMg2qAGw-eVUKz3ClbW2kkeIshg Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 33d03af3f8904c829e5a04755f7e3c1b Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-VolumesActionsTest-1290874327 Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:53:38.338486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/33d03af3f8904c829e5a04755f7e3c1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/33d03af3f8904c829e5a04755f7e3c1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_33d03af3f8904c829e5a04755f7e3c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/33d03af3f8904c829e5a04755f7e3c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-VolumesActionsTest-1290874327 Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 33d03af3f8904c829e5a04755f7e3c1b Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-VolumesActionsTest-1290874327 Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-VolumesActionsTest-1290874327-project Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 9ba1d9d9fe3c4f93b5caa347997814b2 Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-VolumesActionsTest-1290874327-project Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 3ed60172-efba-4ed3-8e82-3ef05bf9522e could not be found. Jun 23 10:53:38.339990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '3ed60172-efba-4ed3-8e82-3ef05bf9522e'} Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed60172-efba-4ed3-8e82-3ef05bf9522e could not be found. Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:53:38.340868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed60172-efba-4ed3-8e82-3ef05bf9522e could not be found. Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed60172-efba-4ed3-8e82-3ef05bf9522e could not be found. Jun 23 10:53:38.342402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:53:38.343456 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Returning 404 to user: Instance 3ed60172-efba-4ed3-8e82-3ef05bf9522e could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:53:38.343456 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-21a9c1d3-c96c-417d-ab76-6e0745ce67c0 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e" status: 404 len: 111 microversion: 2.1 time: 0.032037 Jun 23 10:53:38.343940 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 257/489] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:38 2022] GET /compute/v2.1/servers/3ed60172-efba-4ed3-8e82-3ef05bf9522e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:53:38.459017 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-216674862", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "networks": [{"uuid": "3ffd745f-91b9-41dc-a968-b3b10d98d752"}]}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:38.496602 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-13d5cd78-1f3c-476e-b379-e3aa3e795454 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:38.497263 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-13d5cd78-1f3c-476e-b379-e3aa3e795454 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:38.505649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-13d5cd78-1f3c-476e-b379-e3aa3e795454 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:38.506193 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-13d5cd78-1f3c-476e-b379-e3aa3e795454 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:38.507111 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-13d5cd78-1f3c-476e-b379-e3aa3e795454 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:38.507642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-13d5cd78-1f3c-476e-b379-e3aa3e795454 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:38.514633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] validate_networks() for [('3ffd745f-91b9-41dc-a968-b3b10d98d752', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:53:38.738669 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-13d5cd78-1f3c-476e-b379-e3aa3e795454 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:38.748109 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-13d5cd78-1f3c-476e-b379-e3aa3e795454 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1564 microversion: 2.1 time: 0.256282 Jun 23 10:53:38.755387 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 258/490] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:38 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:38.770011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-efa09e66-459f-4221-962f-341aa0016322 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:38.771681 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-efa09e66-459f-4221-962f-341aa0016322 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:38.778342 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-efa09e66-459f-4221-962f-341aa0016322 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:38.779091 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-efa09e66-459f-4221-962f-341aa0016322 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:38.780312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-efa09e66-459f-4221-962f-341aa0016322 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:38.781199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-efa09e66-459f-4221-962f-341aa0016322 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:39.146938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-efa09e66-459f-4221-962f-341aa0016322 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.383990 Jun 23 10:53:39.148644 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 259/491] 10.222.0.39 () {58 vars in 1274 bytes} [Thu Jun 23 10:53:38 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-interface => generated 285 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:53:39.155572 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2518529a-be16-4506-99f9-e54b7fc0f3bc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:39.156619 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2518529a-be16-4506-99f9-e54b7fc0f3bc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:39.164321 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2518529a-be16-4506-99f9-e54b7fc0f3bc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:39.164831 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2518529a-be16-4506-99f9-e54b7fc0f3bc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:39.165665 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2518529a-be16-4506-99f9-e54b7fc0f3bc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:39.166166 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2518529a-be16-4506-99f9-e54b7fc0f3bc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:39.313355 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2518529a-be16-4506-99f9-e54b7fc0f3bc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:39.352705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2518529a-be16-4506-99f9-e54b7fc0f3bc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1210 microversion: 2.1 time: 0.199409 Jun 23 10:53:39.354834 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 260/492] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:39 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1210 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:39.365631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-4f5ba7d5-c55f-4257-81a8-b221ba001a36 req-40ed9f15-f37e-4eba-a772-de74d65d7005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12221dfe-8cb3-4716-892b-dcc15010c922", "name": "network-vif-plugged", "status": "completed", "tag": "00f19225-fa8c-4963-900a-11b7c2ab039d"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:39.380702 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-4f5ba7d5-c55f-4257-81a8-b221ba001a36 req-40ed9f15-f37e-4eba-a772-de74d65d7005 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:39.381286 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-4f5ba7d5-c55f-4257-81a8-b221ba001a36 req-40ed9f15-f37e-4eba-a772-de74d65d7005 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:39.393463 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-4f5ba7d5-c55f-4257-81a8-b221ba001a36 req-40ed9f15-f37e-4eba-a772-de74d65d7005 service nova] Creating event network-vif-plugged:00f19225-fa8c-4963-900a-11b7c2ab039d for instance 12221dfe-8cb3-4716-892b-dcc15010c922 on hv-cinder-84614 Jun 23 10:53:39.399185 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-4f5ba7d5-c55f-4257-81a8-b221ba001a36 req-40ed9f15-f37e-4eba-a772-de74d65d7005 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041013 Jun 23 10:53:39.400076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 261/493] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:39.407201 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-29b1e286-8f9f-48e5-9b7f-a4395f29cb72 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:39.407999 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-29b1e286-8f9f-48e5-9b7f-a4395f29cb72 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:39.414949 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-29b1e286-8f9f-48e5-9b7f-a4395f29cb72 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:39.415540 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-29b1e286-8f9f-48e5-9b7f-a4395f29cb72 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:39.416409 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-29b1e286-8f9f-48e5-9b7f-a4395f29cb72 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:39.416943 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-29b1e286-8f9f-48e5-9b7f-a4395f29cb72 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:39.551998 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:53:39.553254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:53:39.554128 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:53:39.554717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:53:39.555601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:53:39.567181 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:39.567913 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:39.569101 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:39.569884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:39.595067 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Getting quotas for project 33d03af3f8904c829e5a04755f7e3c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:53:39.602816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Getting quotas for user 9ba1d9d9fe3c4f93b5caa347997814b2 and project 33d03af3f8904c829e5a04755f7e3c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:53:39.617279 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:53:39.619468 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:53:39.678294 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-45d73a41-7c51-42a3-a689-14b8c45d09c6 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.223693 Jun 23 10:53:39.679810 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 233/494] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:53:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:53:39.691119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-73444681-89d8-49c9-a148-069cbe1845bd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:39.692476 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-73444681-89d8-49c9-a148-069cbe1845bd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:39.703405 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-29b1e286-8f9f-48e5-9b7f-a4395f29cb72 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:39.712933 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-29b1e286-8f9f-48e5-9b7f-a4395f29cb72 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.311340 Jun 23 10:53:39.714179 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 262/495] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:39 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:39.802947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-73444681-89d8-49c9-a148-069cbe1845bd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:39.812000 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-73444681-89d8-49c9-a148-069cbe1845bd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1213 microversion: 2.1 time: 0.126328 Jun 23 10:53:39.813054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 234/496] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:39 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:40.373917 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0257fdb0-57cc-4dca-863c-bf8ec780d9f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:40.374634 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0257fdb0-57cc-4dca-863c-bf8ec780d9f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:40.389631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0257fdb0-57cc-4dca-863c-bf8ec780d9f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:40.390391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0257fdb0-57cc-4dca-863c-bf8ec780d9f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:40.391327 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0257fdb0-57cc-4dca-863c-bf8ec780d9f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:40.391916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0257fdb0-57cc-4dca-863c-bf8ec780d9f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:40.589731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0257fdb0-57cc-4dca-863c-bf8ec780d9f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:40.606195 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0257fdb0-57cc-4dca-863c-bf8ec780d9f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1198 microversion: 2.1 time: 0.236074 Jun 23 10:53:40.607424 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 263/497] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:40 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1198 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:40.645887 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-2a46ddb1-0b1e-4001-919f-5d42674cfadf req-20dcb4b3-d942-45c0-9a56-3c83c4329c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7546151-13d3-41c1-b4df-a064682f764a", "tag": "e3febbb8-c828-460d-9a89-e3851649705f"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:40.670088 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-2a46ddb1-0b1e-4001-919f-5d42674cfadf req-20dcb4b3-d942-45c0-9a56-3c83c4329c39 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:40.670631 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-2a46ddb1-0b1e-4001-919f-5d42674cfadf req-20dcb4b3-d942-45c0-9a56-3c83c4329c39 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:40.700022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-2a46ddb1-0b1e-4001-919f-5d42674cfadf req-20dcb4b3-d942-45c0-9a56-3c83c4329c39 service nova] Creating event network-changed:e3febbb8-c828-460d-9a89-e3851649705f for instance a7546151-13d3-41c1-b4df-a064682f764a on hv-cinder-84614 Jun 23 10:53:40.711991 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-2a46ddb1-0b1e-4001-919f-5d42674cfadf req-20dcb4b3-d942-45c0-9a56-3c83c4329c39 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073411 Jun 23 10:53:40.712891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 235/498] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:40.729077 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-6da1c106-1d60-4fa2-86ef-1122b4a54dbb req-d3c79bed-4fc0-4e32-9da7-0e0fadf4f710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b5388c-79f6-4797-a1b9-98518ed970ee", "tag": "dd66f398-76e8-408c-bd60-d35c977b57e5"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:40.732982 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-295af4b9-7814-4b77-ba32-3b492751eadb tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:40.735108 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-295af4b9-7814-4b77-ba32-3b492751eadb tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:40.742211 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-6da1c106-1d60-4fa2-86ef-1122b4a54dbb req-d3c79bed-4fc0-4e32-9da7-0e0fadf4f710 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:40.743007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-6da1c106-1d60-4fa2-86ef-1122b4a54dbb req-d3c79bed-4fc0-4e32-9da7-0e0fadf4f710 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:40.745392 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-295af4b9-7814-4b77-ba32-3b492751eadb tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:40.745849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-295af4b9-7814-4b77-ba32-3b492751eadb tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:40.746656 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-295af4b9-7814-4b77-ba32-3b492751eadb tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:40.747097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-295af4b9-7814-4b77-ba32-3b492751eadb tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:40.758573 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-6da1c106-1d60-4fa2-86ef-1122b4a54dbb req-d3c79bed-4fc0-4e32-9da7-0e0fadf4f710 service nova] Creating event network-changed:dd66f398-76e8-408c-bd60-d35c977b57e5 for instance b0b5388c-79f6-4797-a1b9-98518ed970ee on hv-cinder-84614 Jun 23 10:53:40.764891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-6da1c106-1d60-4fa2-86ef-1122b4a54dbb req-d3c79bed-4fc0-4e32-9da7-0e0fadf4f710 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041933 Jun 23 10:53:40.766157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 264/499] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:40.832783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-442243ba-041b-459c-9fba-79246c328202 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:40.833977 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-442243ba-041b-459c-9fba-79246c328202 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:40.848130 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-442243ba-041b-459c-9fba-79246c328202 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:40.850957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-442243ba-041b-459c-9fba-79246c328202 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:40.853227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-442243ba-041b-459c-9fba-79246c328202 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:40.856498 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-442243ba-041b-459c-9fba-79246c328202 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:40.979268 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-295af4b9-7814-4b77-ba32-3b492751eadb tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:40.999359 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-295af4b9-7814-4b77-ba32-3b492751eadb tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1314 microversion: 2.1 time: 0.263869 Jun 23 10:53:41.001598 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-442243ba-041b-459c-9fba-79246c328202 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:41.003246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 236/500] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:40 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:41.015035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-442243ba-041b-459c-9fba-79246c328202 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1265 microversion: 2.1 time: 0.187574 Jun 23 10:53:41.015621 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 265/501] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:40 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:41.631511 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fa977596-4031-46e0-8287-1a95b211d6b4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:41.632493 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fa977596-4031-46e0-8287-1a95b211d6b4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:41.641689 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa977596-4031-46e0-8287-1a95b211d6b4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:41.643022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa977596-4031-46e0-8287-1a95b211d6b4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:41.645044 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa977596-4031-46e0-8287-1a95b211d6b4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:41.645722 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa977596-4031-46e0-8287-1a95b211d6b4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:41.920914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-fa977596-4031-46e0-8287-1a95b211d6b4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:41.940827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fa977596-4031-46e0-8287-1a95b211d6b4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.315699 Jun 23 10:53:41.941758 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 237/502] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:41 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:42.020884 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-be4f453f-5bd8-4fcf-965d-a0c42e925584 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:42.022276 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-be4f453f-5bd8-4fcf-965d-a0c42e925584 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:42.033036 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5235c62b-7173-4bae-a7c4-84d8b281143d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:42.034670 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5235c62b-7173-4bae-a7c4-84d8b281143d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:42.041716 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5235c62b-7173-4bae-a7c4-84d8b281143d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.045279 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-be4f453f-5bd8-4fcf-965d-a0c42e925584 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.046060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5235c62b-7173-4bae-a7c4-84d8b281143d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:42.047273 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-be4f453f-5bd8-4fcf-965d-a0c42e925584 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:42.049217 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-be4f453f-5bd8-4fcf-965d-a0c42e925584 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.050254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5235c62b-7173-4bae-a7c4-84d8b281143d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.051487 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-be4f453f-5bd8-4fcf-965d-a0c42e925584 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:42.052112 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5235c62b-7173-4bae-a7c4-84d8b281143d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:42.222396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5235c62b-7173-4bae-a7c4-84d8b281143d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:42.245199 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5235c62b-7173-4bae-a7c4-84d8b281143d tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1273 microversion: 2.1 time: 0.215108 Jun 23 10:53:42.252109 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 238/503] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:42 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:42.335378 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-be4f453f-5bd8-4fcf-965d-a0c42e925584 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:42.349119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-be4f453f-5bd8-4fcf-965d-a0c42e925584 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1464 microversion: 2.1 time: 0.333684 Jun 23 10:53:42.354103 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 266/504] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:42 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1464 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:42.430965 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e570c907-98c7-49f9-99cf-05a0de5c038a tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:42.431689 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e570c907-98c7-49f9-99cf-05a0de5c038a tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:42.442857 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e570c907-98c7-49f9-99cf-05a0de5c038a tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.444326 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e570c907-98c7-49f9-99cf-05a0de5c038a tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:42.450988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e570c907-98c7-49f9-99cf-05a0de5c038a tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.451525 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e570c907-98c7-49f9-99cf-05a0de5c038a tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:42.459077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:42.489615 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e570c907-98c7-49f9-99cf-05a0de5c038a tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Going to try to terminate instance {{(pid=129461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:53:42.657573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e570c907-98c7-49f9-99cf-05a0de5c038a tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 204 len: 0 microversion: 2.1 time: 0.230466 Jun 23 10:53:42.658570 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 239/505] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:53:42 2022] DELETE /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:53:42.673074 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d1a26133-aab2-4ce0-b454-8f41117ec499 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:42.673725 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d1a26133-aab2-4ce0-b454-8f41117ec499 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:42.680063 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d1a26133-aab2-4ce0-b454-8f41117ec499 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.680663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d1a26133-aab2-4ce0-b454-8f41117ec499 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:42.681584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d1a26133-aab2-4ce0-b454-8f41117ec499 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.682022 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d1a26133-aab2-4ce0-b454-8f41117ec499 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:42.821696 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d1a26133-aab2-4ce0-b454-8f41117ec499 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:42.829962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d1a26133-aab2-4ce0-b454-8f41117ec499 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1470 microversion: 2.1 time: 0.163444 Jun 23 10:53:42.830725 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 267/506] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:42 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:42.959337 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a691b8c5-b7f9-49a6-9e9b-34d3fd4efe98 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:42.959942 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a691b8c5-b7f9-49a6-9e9b-34d3fd4efe98 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:42.966016 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a691b8c5-b7f9-49a6-9e9b-34d3fd4efe98 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.966502 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a691b8c5-b7f9-49a6-9e9b-34d3fd4efe98 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:42.967857 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a691b8c5-b7f9-49a6-9e9b-34d3fd4efe98 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:42.968299 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a691b8c5-b7f9-49a6-9e9b-34d3fd4efe98 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.058231 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9ff18fc7-4339-4768-9b5b-8ad44b3cb4a4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-253261177"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:43.058773 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9ff18fc7-4339-4768-9b5b-8ad44b3cb4a4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:43.064943 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9ff18fc7-4339-4768-9b5b-8ad44b3cb4a4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.066245 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9ff18fc7-4339-4768-9b5b-8ad44b3cb4a4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.067470 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9ff18fc7-4339-4768-9b5b-8ad44b3cb4a4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.067917 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9ff18fc7-4339-4768-9b5b-8ad44b3cb4a4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.130915 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a691b8c5-b7f9-49a6-9e9b-34d3fd4efe98 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:43.144769 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a691b8c5-b7f9-49a6-9e9b-34d3fd4efe98 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.188281 Jun 23 10:53:43.161376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 240/507] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:42 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:43.169248 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-0a867ced-2c1c-4531-84bf-b92973fe1d80 req-e0ed22b2-91aa-4e06-9318-c303d0efde3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b963bbb2-e54a-4996-82eb-ab728b7f94d4", "tag": "e1aeaec1-0538-4618-bebe-dcb4ef7dba29"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:43.178925 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-0a867ced-2c1c-4531-84bf-b92973fe1d80 req-e0ed22b2-91aa-4e06-9318-c303d0efde3a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.179567 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-0a867ced-2c1c-4531-84bf-b92973fe1d80 req-e0ed22b2-91aa-4e06-9318-c303d0efde3a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.196860 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-0a867ced-2c1c-4531-84bf-b92973fe1d80 req-e0ed22b2-91aa-4e06-9318-c303d0efde3a service nova] Creating event network-changed:e1aeaec1-0538-4618-bebe-dcb4ef7dba29 for instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 on hv-cinder-84614 Jun 23 10:53:43.202374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-0a867ced-2c1c-4531-84bf-b92973fe1d80 req-e0ed22b2-91aa-4e06-9318-c303d0efde3a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039488 Jun 23 10:53:43.203325 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 241/508] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:43.231952 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.network.security_group_api [None req-9ff18fc7-4339-4768-9b5b-8ad44b3cb4a4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Adding security group 52db7a48-207a-4b90-85f5-0572da88d360 to port e3febbb8-c828-460d-9a89-e3851649705f Jun 23 10:53:43.269137 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f55de813-fd31-4317-8f94-e4ed75b5f070 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:43.270038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f55de813-fd31-4317-8f94-e4ed75b5f070 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:43.276604 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f55de813-fd31-4317-8f94-e4ed75b5f070 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.277053 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f55de813-fd31-4317-8f94-e4ed75b5f070 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.277833 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f55de813-fd31-4317-8f94-e4ed75b5f070 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.278273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f55de813-fd31-4317-8f94-e4ed75b5f070 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.363162 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f55de813-fd31-4317-8f94-e4ed75b5f070 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:43.379188 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f55de813-fd31-4317-8f94-e4ed75b5f070 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1271 microversion: 2.1 time: 0.114902 Jun 23 10:53:43.380045 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 242/509] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:43 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:43.660303 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9ff18fc7-4339-4768-9b5b-8ad44b3cb4a4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "POST /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/action" status: 202 len: 0 microversion: 2.1 time: 0.606576 Jun 23 10:53:43.661105 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 268/510] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:53:43 2022] POST /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 10:53:43.675408 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-808e564d-14ef-48fc-94ea-108bfcaa4439 req-52287240-e75a-4217-90b3-cd04aa39f2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7546151-13d3-41c1-b4df-a064682f764a", "tag": "e3febbb8-c828-460d-9a89-e3851649705f"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:43.677766 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3333d2ce-cbf1-4787-98f2-5dba9f977f9f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:43.679412 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3333d2ce-cbf1-4787-98f2-5dba9f977f9f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:43.690087 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-808e564d-14ef-48fc-94ea-108bfcaa4439 req-52287240-e75a-4217-90b3-cd04aa39f2e7 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.693752 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3333d2ce-cbf1-4787-98f2-5dba9f977f9f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.694439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-808e564d-14ef-48fc-94ea-108bfcaa4439 req-52287240-e75a-4217-90b3-cd04aa39f2e7 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.694928 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3333d2ce-cbf1-4787-98f2-5dba9f977f9f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.695761 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3333d2ce-cbf1-4787-98f2-5dba9f977f9f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.698796 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3333d2ce-cbf1-4787-98f2-5dba9f977f9f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.713288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-808e564d-14ef-48fc-94ea-108bfcaa4439 req-52287240-e75a-4217-90b3-cd04aa39f2e7 service nova] Creating event network-changed:e3febbb8-c828-460d-9a89-e3851649705f for instance a7546151-13d3-41c1-b4df-a064682f764a on hv-cinder-84614 Jun 23 10:53:43.719086 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-808e564d-14ef-48fc-94ea-108bfcaa4439 req-52287240-e75a-4217-90b3-cd04aa39f2e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049281 Jun 23 10:53:43.723995 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 269/511] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:43.849196 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-750c54a7-b1fa-4e92-9b04-ce1d28f176db tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:43.850257 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-750c54a7-b1fa-4e92-9b04-ce1d28f176db tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:43.857655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-750c54a7-b1fa-4e92-9b04-ce1d28f176db tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.858391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-750c54a7-b1fa-4e92-9b04-ce1d28f176db tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.859353 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-750c54a7-b1fa-4e92-9b04-ce1d28f176db tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:43.859951 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-750c54a7-b1fa-4e92-9b04-ce1d28f176db tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:43.882566 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3333d2ce-cbf1-4787-98f2-5dba9f977f9f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:43.890773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3333d2ce-cbf1-4787-98f2-5dba9f977f9f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1640 microversion: 2.1 time: 0.225260 Jun 23 10:53:43.891344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 243/512] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:43 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1640 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:44.000692 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-750c54a7-b1fa-4e92-9b04-ce1d28f176db tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:44.009360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-750c54a7-b1fa-4e92-9b04-ce1d28f176db tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1470 microversion: 2.1 time: 0.164985 Jun 23 10:53:44.009922 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 270/513] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:43 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:44.162582 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-17273664-0cb9-44d5-beb2-167ab92e4805 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:44.164101 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-17273664-0cb9-44d5-beb2-167ab92e4805 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:44.170263 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-17273664-0cb9-44d5-beb2-167ab92e4805 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:44.171224 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-17273664-0cb9-44d5-beb2-167ab92e4805 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:44.171992 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-17273664-0cb9-44d5-beb2-167ab92e4805 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:44.172424 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-17273664-0cb9-44d5-beb2-167ab92e4805 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:44.327944 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-17273664-0cb9-44d5-beb2-167ab92e4805 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:44.337172 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-17273664-0cb9-44d5-beb2-167ab92e4805 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.178960 Jun 23 10:53:44.338094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 244/514] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:44 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:44.396908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4521e411-db33-4fd2-98e6-07a116675937 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:44.397486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4521e411-db33-4fd2-98e6-07a116675937 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:44.400451 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:44.406138 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4521e411-db33-4fd2-98e6-07a116675937 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:44.406608 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4521e411-db33-4fd2-98e6-07a116675937 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:44.407420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4521e411-db33-4fd2-98e6-07a116675937 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:44.407855 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4521e411-db33-4fd2-98e6-07a116675937 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:44.473582 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4521e411-db33-4fd2-98e6-07a116675937 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:44.481735 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4521e411-db33-4fd2-98e6-07a116675937 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1271 microversion: 2.1 time: 0.089433 Jun 23 10:53:44.482307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 271/515] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:44 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:45.027520 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-06e546df-3f99-4493-accb-be2446d24b0d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:45.029629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-06e546df-3f99-4493-accb-be2446d24b0d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:45.036675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-06e546df-3f99-4493-accb-be2446d24b0d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:45.037358 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-06e546df-3f99-4493-accb-be2446d24b0d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:45.038284 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-06e546df-3f99-4493-accb-be2446d24b0d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:45.038751 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-06e546df-3f99-4493-accb-be2446d24b0d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:45.175395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-06e546df-3f99-4493-accb-be2446d24b0d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b116b882c141f29eef749cd9a8a5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239b2eb649884802b59347962a7bfa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:45.189191 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-06e546df-3f99-4493-accb-be2446d24b0d tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 200 len: 1428 microversion: 2.1 time: 0.166079 Jun 23 10:53:45.201576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 245/516] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:45 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 1428 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:45.354843 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b9876585-0522-48b6-8776-fe2d6755f188 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:45.355673 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b9876585-0522-48b6-8776-fe2d6755f188 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:45.364278 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b9876585-0522-48b6-8776-fe2d6755f188 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:45.364720 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b9876585-0522-48b6-8776-fe2d6755f188 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:45.365725 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b9876585-0522-48b6-8776-fe2d6755f188 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:45.366157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b9876585-0522-48b6-8776-fe2d6755f188 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:45.499212 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-bba0e9b9-5cb1-4caf-a186-f84fac030f71 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:45.499872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-bba0e9b9-5cb1-4caf-a186-f84fac030f71 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:45.503678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b9876585-0522-48b6-8776-fe2d6755f188 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:45.506242 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bba0e9b9-5cb1-4caf-a186-f84fac030f71 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:45.506712 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bba0e9b9-5cb1-4caf-a186-f84fac030f71 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:45.507467 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bba0e9b9-5cb1-4caf-a186-f84fac030f71 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:45.507889 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bba0e9b9-5cb1-4caf-a186-f84fac030f71 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:45.513787 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b9876585-0522-48b6-8776-fe2d6755f188 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.162857 Jun 23 10:53:45.514369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 272/517] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:45 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:45.645649 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-bba0e9b9-5cb1-4caf-a186-f84fac030f71 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:45.654378 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-bba0e9b9-5cb1-4caf-a186-f84fac030f71 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.158954 Jun 23 10:53:45.655038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 246/518] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:45 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:45.736169 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-59ac61e7-89cc-4eef-b2ae-8f868a7d7ab5 req-890ad7a9-0d1d-40d9-95b1-27edb9217957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12221dfe-8cb3-4716-892b-dcc15010c922", "name": "network-vif-deleted", "tag": "00f19225-fa8c-4963-900a-11b7c2ab039d"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:45.745675 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-59ac61e7-89cc-4eef-b2ae-8f868a7d7ab5 req-890ad7a9-0d1d-40d9-95b1-27edb9217957 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:45.746624 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-59ac61e7-89cc-4eef-b2ae-8f868a7d7ab5 req-890ad7a9-0d1d-40d9-95b1-27edb9217957 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:45.760184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-59ac61e7-89cc-4eef-b2ae-8f868a7d7ab5 req-890ad7a9-0d1d-40d9-95b1-27edb9217957 service nova] Creating event network-vif-deleted:00f19225-fa8c-4963-900a-11b7c2ab039d for instance 12221dfe-8cb3-4716-892b-dcc15010c922 on hv-cinder-84614 Jun 23 10:53:45.765188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-59ac61e7-89cc-4eef-b2ae-8f868a7d7ab5 req-890ad7a9-0d1d-40d9-95b1-27edb9217957 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Jun 23 10:53:45.770170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 273/519] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:46.208979 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:46.209779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] [instance: 12221dfe-8cb3-4716-892b-dcc15010c922] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:46.216419 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:46.216890 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:46.217657 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:46.218091 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:46.232725 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] HTTP exception thrown: Instance 12221dfe-8cb3-4716-892b-dcc15010c922 could not be found. Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Request method failure captured: Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 HTTP/1.1 Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEYfYTG_d6YxU6je6LTM7ebFGJPUpfnkyqWftFfclKVGPI1FMzrTasTPOtJ2u8aycD2W5W7VDdn2uCATZU0oJsrK90sxu1Ri-VWZMVUjdRyB-x9_Ze7UfL4fHT1XisGHo7BBsf_DfG1vnLKRnN1JQlev4DFTE0GntRPsUegTB-nd82M Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 239b2eb649884802b59347962a7bfa88 Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesNegativeTest-741446841 Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:53:46.234373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/239b2eb649884802b59347962a7bfa88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/239b2eb649884802b59347962a7bfa88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_239b2eb649884802b59347962a7bfa88", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/239b2eb649884802b59347962a7bfa88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesNegativeTest-741446841 Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 239b2eb649884802b59347962a7bfa88 Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesNegativeTest-741446841 Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesNegativeTest-741446841-project Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: c1b116b882c141f29eef749cd9a8a5ea Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesNegativeTest-741446841-project Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 12221dfe-8cb3-4716-892b-dcc15010c922 could not be found. Jun 23 10:53:46.235882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '12221dfe-8cb3-4716-892b-dcc15010c922'} Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12221dfe-8cb3-4716-892b-dcc15010c922 could not be found. Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:53:46.237329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12221dfe-8cb3-4716-892b-dcc15010c922 could not be found. Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12221dfe-8cb3-4716-892b-dcc15010c922 could not be found. Jun 23 10:53:46.239117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:53:46.240267 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] Returning 404 to user: Instance 12221dfe-8cb3-4716-892b-dcc15010c922 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:53:46.240267 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3060059e-3b6a-4114-91b0-9dd39e2b3bf7 tempest-VolumesNegativeTest-741446841 tempest-VolumesNegativeTest-741446841-project] 10.222.0.39 "GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922" status: 404 len: 111 microversion: 2.1 time: 0.031548 Jun 23 10:53:46.240267 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 247/520] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:46 2022] GET /compute/v2.1/servers/12221dfe-8cb3-4716-892b-dcc15010c922 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:53:46.533234 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5130b713-e1e0-441e-b820-641c7ebff778 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:46.534594 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5130b713-e1e0-441e-b820-641c7ebff778 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:46.546442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5130b713-e1e0-441e-b820-641c7ebff778 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:46.546966 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5130b713-e1e0-441e-b820-641c7ebff778 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:46.547797 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5130b713-e1e0-441e-b820-641c7ebff778 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:46.548291 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5130b713-e1e0-441e-b820-641c7ebff778 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:46.598612 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f2241f7c-4e20-4937-b7b1-1fd3304c0983 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:46.599376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f2241f7c-4e20-4937-b7b1-1fd3304c0983 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:46.606536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f2241f7c-4e20-4937-b7b1-1fd3304c0983 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:46.607249 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f2241f7c-4e20-4937-b7b1-1fd3304c0983 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:46.608688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f2241f7c-4e20-4937-b7b1-1fd3304c0983 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:46.609422 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f2241f7c-4e20-4937-b7b1-1fd3304c0983 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:46.638780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f2241f7c-4e20-4937-b7b1-1fd3304c0983 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/ips" status: 200 len: 149 microversion: 2.1 time: 0.046001 Jun 23 10:53:46.640905 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 248/521] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 10:53:46 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:53:46.690615 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-675a967a-b67c-4af1-b558-71538152023f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:46.692454 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-675a967a-b67c-4af1-b558-71538152023f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:46.703645 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-675a967a-b67c-4af1-b558-71538152023f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:46.704583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-675a967a-b67c-4af1-b558-71538152023f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:46.706406 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-675a967a-b67c-4af1-b558-71538152023f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:46.707090 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-675a967a-b67c-4af1-b558-71538152023f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:46.726039 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5130b713-e1e0-441e-b820-641c7ebff778 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:46.735776 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5130b713-e1e0-441e-b820-641c7ebff778 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.206820 Jun 23 10:53:46.737914 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 274/522] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:46 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:46.887502 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-675a967a-b67c-4af1-b558-71538152023f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:46.897567 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-675a967a-b67c-4af1-b558-71538152023f tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.228915 Jun 23 10:53:46.908732 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 249/523] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:46 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:47.224125 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-3a23d2b3-1242-42fd-a68a-da588d0104e8 req-bacd748d-a974-47d9-b933-32c569ed03a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a", "tag": "bdf6ebc0-baa7-46dd-ac91-4a21f914e3d7"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:47.233052 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-3a23d2b3-1242-42fd-a68a-da588d0104e8 req-bacd748d-a974-47d9-b933-32c569ed03a3 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:47.233589 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-3a23d2b3-1242-42fd-a68a-da588d0104e8 req-bacd748d-a974-47d9-b933-32c569ed03a3 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:47.248068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-3a23d2b3-1242-42fd-a68a-da588d0104e8 req-bacd748d-a974-47d9-b933-32c569ed03a3 service nova] Creating event network-changed:bdf6ebc0-baa7-46dd-ac91-4a21f914e3d7 for instance e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a on hv-cinder-84614 Jun 23 10:53:47.253237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-3a23d2b3-1242-42fd-a68a-da588d0104e8 req-bacd748d-a974-47d9-b933-32c569ed03a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032762 Jun 23 10:53:47.253828 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 275/524] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:47.754498 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1a1427cc-f8c3-44af-9642-1b4c63d4a8cb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:47.755114 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1a1427cc-f8c3-44af-9642-1b4c63d4a8cb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:47.763383 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a1427cc-f8c3-44af-9642-1b4c63d4a8cb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:47.763901 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a1427cc-f8c3-44af-9642-1b4c63d4a8cb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:47.764730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a1427cc-f8c3-44af-9642-1b4c63d4a8cb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:47.765242 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a1427cc-f8c3-44af-9642-1b4c63d4a8cb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:47.907718 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1a1427cc-f8c3-44af-9642-1b4c63d4a8cb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:47.913143 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:47.916720 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1a1427cc-f8c3-44af-9642-1b4c63d4a8cb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.167565 Jun 23 10:53:47.917436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 250/525] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:47 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:47.917833 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9e93b4de-af68-4728-9ee0-03c539fb8340 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:47.918628 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9e93b4de-af68-4728-9ee0-03c539fb8340 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:47.925892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e93b4de-af68-4728-9ee0-03c539fb8340 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:47.926374 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e93b4de-af68-4728-9ee0-03c539fb8340 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:47.927182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e93b4de-af68-4728-9ee0-03c539fb8340 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:47.927748 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e93b4de-af68-4728-9ee0-03c539fb8340 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:48.063887 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9e93b4de-af68-4728-9ee0-03c539fb8340 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:48.071993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9e93b4de-af68-4728-9ee0-03c539fb8340 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.159824 Jun 23 10:53:48.072560 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 276/526] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:47 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:48.186654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fbbab75d-77ea-4c15-818f-ff337c3c97bc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dae14c38-7a7e-4aa6-80c7-63bb502758d1"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:48.188152 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fbbab75d-77ea-4c15-818f-ff337c3c97bc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:48.194989 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fbbab75d-77ea-4c15-818f-ff337c3c97bc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:48.195438 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fbbab75d-77ea-4c15-818f-ff337c3c97bc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:48.196207 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fbbab75d-77ea-4c15-818f-ff337c3c97bc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:48.196651 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fbbab75d-77ea-4c15-818f-ff337c3c97bc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:48.523734 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fbbab75d-77ea-4c15-818f-ff337c3c97bc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340843 Jun 23 10:53:48.525322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 251/527] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 10:53:48 2022] POST /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:48.932607 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a7852df5-5e59-4035-9212-4d095559f729 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:48.933204 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a7852df5-5e59-4035-9212-4d095559f729 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:48.944360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a7852df5-5e59-4035-9212-4d095559f729 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:48.945050 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a7852df5-5e59-4035-9212-4d095559f729 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:48.946043 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a7852df5-5e59-4035-9212-4d095559f729 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:48.946992 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a7852df5-5e59-4035-9212-4d095559f729 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:48.964345 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:49.090334 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-216a6a52-a2d0-408e-8c64-015dd3ae1124 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:49.091479 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-216a6a52-a2d0-408e-8c64-015dd3ae1124 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:49.098594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-216a6a52-a2d0-408e-8c64-015dd3ae1124 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:49.099173 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-216a6a52-a2d0-408e-8c64-015dd3ae1124 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:49.099336 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a7852df5-5e59-4035-9212-4d095559f729 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:49.100821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-216a6a52-a2d0-408e-8c64-015dd3ae1124 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:49.101327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-216a6a52-a2d0-408e-8c64-015dd3ae1124 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:49.108185 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a7852df5-5e59-4035-9212-4d095559f729 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.179221 Jun 23 10:53:49.108747 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 277/528] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:48 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:49.255322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-216a6a52-a2d0-408e-8c64-015dd3ae1124 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:49.262738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-216a6a52-a2d0-408e-8c64-015dd3ae1124 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.176970 Jun 23 10:53:49.263290 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 252/529] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:49 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:50.125865 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6a84f665-648a-43b5-9268-c31a898b155d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:50.126420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6a84f665-648a-43b5-9268-c31a898b155d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:50.132800 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6a84f665-648a-43b5-9268-c31a898b155d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:50.133249 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6a84f665-648a-43b5-9268-c31a898b155d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:50.134016 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6a84f665-648a-43b5-9268-c31a898b155d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:50.134491 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6a84f665-648a-43b5-9268-c31a898b155d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:50.272551 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6a84f665-648a-43b5-9268-c31a898b155d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:50.280141 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c3ddf2b8-71a6-4bc5-a6fd-c2a0e83806d1 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:50.281464 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c3ddf2b8-71a6-4bc5-a6fd-c2a0e83806d1 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:50.282309 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6a84f665-648a-43b5-9268-c31a898b155d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.160229 Jun 23 10:53:50.282840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 278/530] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:50 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:50.285444 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=4 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:50.286387 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=14 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:50.290251 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c3ddf2b8-71a6-4bc5-a6fd-c2a0e83806d1 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:50.290728 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c3ddf2b8-71a6-4bc5-a6fd-c2a0e83806d1 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:50.291675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c3ddf2b8-71a6-4bc5-a6fd-c2a0e83806d1 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:50.292116 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c3ddf2b8-71a6-4bc5-a6fd-c2a0e83806d1 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:50.427610 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c3ddf2b8-71a6-4bc5-a6fd-c2a0e83806d1 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:50.434949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c3ddf2b8-71a6-4bc5-a6fd-c2a0e83806d1 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.158837 Jun 23 10:53:50.435500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 253/531] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:50 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:51.299039 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b6a7e6b7-9c91-4d6b-ae6a-7c3015b42514 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:51.300252 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b6a7e6b7-9c91-4d6b-ae6a-7c3015b42514 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:51.306801 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b6a7e6b7-9c91-4d6b-ae6a-7c3015b42514 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:51.307240 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b6a7e6b7-9c91-4d6b-ae6a-7c3015b42514 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:51.307997 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b6a7e6b7-9c91-4d6b-ae6a-7c3015b42514 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:51.308423 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b6a7e6b7-9c91-4d6b-ae6a-7c3015b42514 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:51.449685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b6a7e6b7-9c91-4d6b-ae6a-7c3015b42514 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:51.452284 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fca5e0ca-8520-41ec-9cf3-19f2f797d5db tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:51.452893 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fca5e0ca-8520-41ec-9cf3-19f2f797d5db tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:51.458170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b6a7e6b7-9c91-4d6b-ae6a-7c3015b42514 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.163018 Jun 23 10:53:51.458764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 279/532] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:51 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:51.459893 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fca5e0ca-8520-41ec-9cf3-19f2f797d5db tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:51.460330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fca5e0ca-8520-41ec-9cf3-19f2f797d5db tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:51.461084 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fca5e0ca-8520-41ec-9cf3-19f2f797d5db tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:51.461509 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fca5e0ca-8520-41ec-9cf3-19f2f797d5db tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:51.476797 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:51.594270 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-fca5e0ca-8520-41ec-9cf3-19f2f797d5db tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:51.601681 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fca5e0ca-8520-41ec-9cf3-19f2f797d5db tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.153367 Jun 23 10:53:51.602228 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 254/533] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:51 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:52.474835 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a9a2535a-112b-405d-8ead-2135bd743ddb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:52.475433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a9a2535a-112b-405d-8ead-2135bd743ddb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:52.481547 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a9a2535a-112b-405d-8ead-2135bd743ddb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:52.481989 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a9a2535a-112b-405d-8ead-2135bd743ddb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:52.482775 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a9a2535a-112b-405d-8ead-2135bd743ddb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:52.483203 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a9a2535a-112b-405d-8ead-2135bd743ddb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:52.615900 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a9a2535a-112b-405d-8ead-2135bd743ddb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:52.621666 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-890beca9-f1d2-445d-b9e8-74722593f2fd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:52.622326 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-890beca9-f1d2-445d-b9e8-74722593f2fd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:52.623456 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a9a2535a-112b-405d-8ead-2135bd743ddb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.152483 Jun 23 10:53:52.624014 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 280/534] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:52 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:52.629910 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-890beca9-f1d2-445d-b9e8-74722593f2fd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:52.630380 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-890beca9-f1d2-445d-b9e8-74722593f2fd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:52.631140 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-890beca9-f1d2-445d-b9e8-74722593f2fd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:52.631574 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-890beca9-f1d2-445d-b9e8-74722593f2fd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:52.764257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-890beca9-f1d2-445d-b9e8-74722593f2fd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:52.772844 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-890beca9-f1d2-445d-b9e8-74722593f2fd tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.154926 Jun 23 10:53:52.773951 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 255/535] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:52 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:53.640603 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8624e29b-f116-42e2-b632-30918d762e59 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:53.641150 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8624e29b-f116-42e2-b632-30918d762e59 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:53.647307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8624e29b-f116-42e2-b632-30918d762e59 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:53.647780 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8624e29b-f116-42e2-b632-30918d762e59 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:53.648535 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8624e29b-f116-42e2-b632-30918d762e59 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:53.648972 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8624e29b-f116-42e2-b632-30918d762e59 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:53.778324 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8624e29b-f116-42e2-b632-30918d762e59 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:53.786587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8624e29b-f116-42e2-b632-30918d762e59 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.149794 Jun 23 10:53:53.787151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 281/536] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:53 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:53.789978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-11649fcd-a9a9-4d77-85f8-53fcd4cc0969 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:53.790714 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-11649fcd-a9a9-4d77-85f8-53fcd4cc0969 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:53.793169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:53.798528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-11649fcd-a9a9-4d77-85f8-53fcd4cc0969 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:53.798975 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-11649fcd-a9a9-4d77-85f8-53fcd4cc0969 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:53.800453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-11649fcd-a9a9-4d77-85f8-53fcd4cc0969 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:53.800899 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-11649fcd-a9a9-4d77-85f8-53fcd4cc0969 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:53.939102 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-11649fcd-a9a9-4d77-85f8-53fcd4cc0969 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:53.947062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-11649fcd-a9a9-4d77-85f8-53fcd4cc0969 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.161058 Jun 23 10:53:53.947608 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 256/537] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:53 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:54.803906 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5b3db015-2e6b-41ad-b0df-ec012c9e5492 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:54.804529 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5b3db015-2e6b-41ad-b0df-ec012c9e5492 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:54.810412 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5b3db015-2e6b-41ad-b0df-ec012c9e5492 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:54.810860 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5b3db015-2e6b-41ad-b0df-ec012c9e5492 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:54.811618 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5b3db015-2e6b-41ad-b0df-ec012c9e5492 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:54.812047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5b3db015-2e6b-41ad-b0df-ec012c9e5492 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:54.953211 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5b3db015-2e6b-41ad-b0df-ec012c9e5492 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:54.963769 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5b3db015-2e6b-41ad-b0df-ec012c9e5492 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.164428 Jun 23 10:53:54.964067 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-727e51d9-b0bf-41d6-847c-3b1e1c86ce11 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:54.964576 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 282/538] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:54 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:54.965442 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-727e51d9-b0bf-41d6-847c-3b1e1c86ce11 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:54.968694 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-26d88d09-4814-49a5-9b75-7721833b764f req-29fc0d2f-65a1-4a22-ba59-8cb9fda3dad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a", "name": "network-vif-plugged", "status": "completed", "tag": "bdf6ebc0-baa7-46dd-ac91-4a21f914e3d7"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:54.972787 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-727e51d9-b0bf-41d6-847c-3b1e1c86ce11 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:54.973527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-727e51d9-b0bf-41d6-847c-3b1e1c86ce11 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:54.974204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-727e51d9-b0bf-41d6-847c-3b1e1c86ce11 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:54.974936 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-727e51d9-b0bf-41d6-847c-3b1e1c86ce11 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:54.977233 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-26d88d09-4814-49a5-9b75-7721833b764f req-29fc0d2f-65a1-4a22-ba59-8cb9fda3dad0 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:54.977845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-26d88d09-4814-49a5-9b75-7721833b764f req-29fc0d2f-65a1-4a22-ba59-8cb9fda3dad0 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:54.992420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-26d88d09-4814-49a5-9b75-7721833b764f req-29fc0d2f-65a1-4a22-ba59-8cb9fda3dad0 service nova] Creating event network-vif-plugged:bdf6ebc0-baa7-46dd-ac91-4a21f914e3d7 for instance e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a on hv-cinder-84614 Jun 23 10:53:54.997892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-26d88d09-4814-49a5-9b75-7721833b764f req-29fc0d2f-65a1-4a22-ba59-8cb9fda3dad0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032472 Jun 23 10:53:54.999475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 283/539] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:55.115401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-727e51d9-b0bf-41d6-847c-3b1e1c86ce11 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:55.124031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-727e51d9-b0bf-41d6-847c-3b1e1c86ce11 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.163640 Jun 23 10:53:55.124882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 257/540] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:54 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:55.642126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1f3fab51-c075-467d-b2e1-dc39ccbd3cee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:55.642646 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1f3fab51-c075-467d-b2e1-dc39ccbd3cee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:55.649088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1f3fab51-c075-467d-b2e1-dc39ccbd3cee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:55.649522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1f3fab51-c075-467d-b2e1-dc39ccbd3cee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:55.650274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1f3fab51-c075-467d-b2e1-dc39ccbd3cee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:55.650714 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1f3fab51-c075-467d-b2e1-dc39ccbd3cee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:55.673217 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1f3fab51-c075-467d-b2e1-dc39ccbd3cee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/ips" status: 200 len: 151 microversion: 2.20 time: 0.035343 Jun 23 10:53:55.673772 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 284/541] 10.222.0.39 () {60 vars in 1288 bytes} [Thu Jun 23 10:53:55 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:53:55.980769 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e4ed0bb0-a368-4b1a-a664-1d6c21d9a5bf tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:55.981369 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e4ed0bb0-a368-4b1a-a664-1d6c21d9a5bf tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:55.988541 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4ed0bb0-a368-4b1a-a664-1d6c21d9a5bf tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:55.989028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4ed0bb0-a368-4b1a-a664-1d6c21d9a5bf tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:55.990111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4ed0bb0-a368-4b1a-a664-1d6c21d9a5bf tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:55.990554 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e4ed0bb0-a368-4b1a-a664-1d6c21d9a5bf tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:56.124516 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e4ed0bb0-a368-4b1a-a664-1d6c21d9a5bf tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:56.133032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e4ed0bb0-a368-4b1a-a664-1d6c21d9a5bf tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.156403 Jun 23 10:53:56.133619 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 258/542] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:55 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:56.140566 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-18482073-d004-4894-bdbb-02af38c00122 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:56.141315 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-18482073-d004-4894-bdbb-02af38c00122 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:56.147533 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18482073-d004-4894-bdbb-02af38c00122 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:56.147978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18482073-d004-4894-bdbb-02af38c00122 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:56.148737 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18482073-d004-4894-bdbb-02af38c00122 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:56.149169 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18482073-d004-4894-bdbb-02af38c00122 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:56.282666 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-18482073-d004-4894-bdbb-02af38c00122 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:56.290034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-18482073-d004-4894-bdbb-02af38c00122 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.153290 Jun 23 10:53:56.290617 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 285/543] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:56 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:57.150159 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-32131f52-1b84-48f4-81c4-864c1ed9498e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:57.150775 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-32131f52-1b84-48f4-81c4-864c1ed9498e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:57.157573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-32131f52-1b84-48f4-81c4-864c1ed9498e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:57.157865 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-32131f52-1b84-48f4-81c4-864c1ed9498e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:57.158645 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-32131f52-1b84-48f4-81c4-864c1ed9498e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:57.159144 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-32131f52-1b84-48f4-81c4-864c1ed9498e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:57.287582 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-32131f52-1b84-48f4-81c4-864c1ed9498e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:57.295312 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-32131f52-1b84-48f4-81c4-864c1ed9498e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.148962 Jun 23 10:53:57.296156 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 259/544] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:57 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:57.307036 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fea944b3-ab9d-4c3e-97f3-f39c7091069b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:57.307708 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fea944b3-ab9d-4c3e-97f3-f39c7091069b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:57.314129 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fea944b3-ab9d-4c3e-97f3-f39c7091069b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:57.314620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fea944b3-ab9d-4c3e-97f3-f39c7091069b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:57.316028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fea944b3-ab9d-4c3e-97f3-f39c7091069b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:57.316463 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fea944b3-ab9d-4c3e-97f3-f39c7091069b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:57.451120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fea944b3-ab9d-4c3e-97f3-f39c7091069b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:57.459619 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fea944b3-ab9d-4c3e-97f3-f39c7091069b tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1313 microversion: 2.1 time: 0.156460 Jun 23 10:53:57.460180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 286/545] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:57 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:57.902058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0fb9e8ca-9c2b-402e-ad97-008ca290f9f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:57.902625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-0fb9e8ca-9c2b-402e-ad97-008ca290f9f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:57.908609 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0fb9e8ca-9c2b-402e-ad97-008ca290f9f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:57.909276 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0fb9e8ca-9c2b-402e-ad97-008ca290f9f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:57.910070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0fb9e8ca-9c2b-402e-ad97-008ca290f9f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:57.910546 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0fb9e8ca-9c2b-402e-ad97-008ca290f9f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:57.932418 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-0fb9e8ca-9c2b-402e-ad97-008ca290f9f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lazy-loading 'flavor' on Instance uuid 737a2c37-15f8-4f42-a879-af5af910fd30 {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:53:58.229076 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0fb9e8ca-9c2b-402e-ad97-008ca290f9f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/action" status: 202 len: 0 microversion: 2.20 time: 0.330767 Jun 23 10:53:58.229668 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 260/546] 10.222.0.39 () {62 vars in 1318 bytes} [Thu Jun 23 10:53:57 2022] POST /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:53:58.238825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:58.239429 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:58.245448 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:58.245893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:58.246676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:58.247108 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:58.313359 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-96af0639-5f53-43f4-a768-8b91e491ff5a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:58.314087 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-96af0639-5f53-43f4-a768-8b91e491ff5a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:58.321084 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96af0639-5f53-43f4-a768-8b91e491ff5a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:58.321534 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96af0639-5f53-43f4-a768-8b91e491ff5a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:58.322303 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96af0639-5f53-43f4-a768-8b91e491ff5a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:58.322755 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96af0639-5f53-43f4-a768-8b91e491ff5a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:58.414814 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:58.422788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:58.424402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:58.425975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-af45a934-f743-4f0f-80e3-dac9562d77a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.192077 Jun 23 10:53:58.426629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 287/547] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:53:58 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:53:58.474030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-96af0639-5f53-43f4-a768-8b91e491ff5a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:58.477120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f225468d-5004-4aa3-8d1c-d6420888b380 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:58.477727 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f225468d-5004-4aa3-8d1c-d6420888b380 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:58.481846 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-96af0639-5f53-43f4-a768-8b91e491ff5a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.172660 Jun 23 10:53:58.482507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 261/548] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:58 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:58.484639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f225468d-5004-4aa3-8d1c-d6420888b380 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:58.485085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f225468d-5004-4aa3-8d1c-d6420888b380 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:58.485881 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f225468d-5004-4aa3-8d1c-d6420888b380 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:58.486309 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f225468d-5004-4aa3-8d1c-d6420888b380 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:58.626809 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f225468d-5004-4aa3-8d1c-d6420888b380 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:58.635166 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f225468d-5004-4aa3-8d1c-d6420888b380 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1498 microversion: 2.1 time: 0.161808 Jun 23 10:53:58.635724 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 288/549] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:58 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:53:59.117667 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c6e129a2-4cca-4a4d-94d4-c64025496cd4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:59.118158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c6e129a2-4cca-4a4d-94d4-c64025496cd4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:59.124139 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c6e129a2-4cca-4a4d-94d4-c64025496cd4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:59.124790 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c6e129a2-4cca-4a4d-94d4-c64025496cd4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:59.125979 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c6e129a2-4cca-4a4d-94d4-c64025496cd4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:59.126606 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c6e129a2-4cca-4a4d-94d4-c64025496cd4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:59.154330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c6e129a2-4cca-4a4d-94d4-c64025496cd4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Going to try to terminate instance {{(pid=129461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:53:59.171272 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-6c665570-43ac-4448-98cf-6e483c9c316f req-57a5fbe1-edc3-4e94-a5d4-d3c47c0f8e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b963bbb2-e54a-4996-82eb-ab728b7f94d4", "name": "network-vif-plugged", "status": "completed", "tag": "e1aeaec1-0538-4618-bebe-dcb4ef7dba29"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:59.186591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-6c665570-43ac-4448-98cf-6e483c9c316f req-57a5fbe1-edc3-4e94-a5d4-d3c47c0f8e9b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:59.187038 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-6c665570-43ac-4448-98cf-6e483c9c316f req-57a5fbe1-edc3-4e94-a5d4-d3c47c0f8e9b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:59.203095 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-6c665570-43ac-4448-98cf-6e483c9c316f req-57a5fbe1-edc3-4e94-a5d4-d3c47c0f8e9b service nova] Creating event network-vif-plugged:e1aeaec1-0538-4618-bebe-dcb4ef7dba29 for instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 on hv-cinder-84614 Jun 23 10:53:59.216151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-6c665570-43ac-4448-98cf-6e483c9c316f req-57a5fbe1-edc3-4e94-a5d4-d3c47c0f8e9b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047920 Jun 23 10:53:59.218023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 289/550] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:53:59.252994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0f66a3f4-29f7-45b7-bbe6-82f15624ecf1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: .version_select at 0x7f8dc92f85e0>, body: {"keypair": {"name": "tempest-keypair-1270310407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB26VLFPUj2G57+WenXbcTTvt/pSW5SSrdx571/1ainmiKkWhc7FJpczClj+U4GJ+dPCEvDZw6kzHi2BQeX6hq2Z16FRfrz8wlaE6DDDwKIs6d5IR7v/dPAhRJvNN5xCA=="}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:53:59.265036 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c6e129a2-4cca-4a4d-94d4-c64025496cd4 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 204 len: 0 microversion: 2.1 time: 0.150680 Jun 23 10:53:59.265964 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 262/551] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:53:59 2022] DELETE /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:53:59.274027 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-0f66a3f4-29f7-45b7-bbe6-82f15624ecf1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for project 2123ff10502044b9aea48720440c2291. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:53:59.278716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-0f66a3f4-29f7-45b7-bbe6-82f15624ecf1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for user eb8df5670686403480cdfd32ac408945 and project 2123ff10502044b9aea48720440c2291. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:53:59.280078 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3dd58627-dbdd-4065-9e95-b5ef3a9a0e38 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:59.280877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3dd58627-dbdd-4065-9e95-b5ef3a9a0e38 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:59.287119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3dd58627-dbdd-4065-9e95-b5ef3a9a0e38 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:59.287912 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3dd58627-dbdd-4065-9e95-b5ef3a9a0e38 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:59.288794 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3dd58627-dbdd-4065-9e95-b5ef3a9a0e38 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:59.289578 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3dd58627-dbdd-4065-9e95-b5ef3a9a0e38 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:59.302030 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0f66a3f4-29f7-45b7-bbe6-82f15624ecf1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053624 Jun 23 10:53:59.302652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 290/552] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 10:53:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:53:59.429462 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3dd58627-dbdd-4065-9e95-b5ef3a9a0e38 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:59.437737 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3dd58627-dbdd-4065-9e95-b5ef3a9a0e38 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1504 microversion: 2.1 time: 0.166569 Jun 23 10:53:59.438291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 263/553] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:59 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:53:59.444735 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:59.445950 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:59.452488 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:59.452956 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:59.453704 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:59.454130 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:59.498161 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-07e28a83-2174-4af3-9a98-bbc601829d40 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:59.499211 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-07e28a83-2174-4af3-9a98-bbc601829d40 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:53:59.506628 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-07e28a83-2174-4af3-9a98-bbc601829d40 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:59.507371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-07e28a83-2174-4af3-9a98-bbc601829d40 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:59.508913 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-07e28a83-2174-4af3-9a98-bbc601829d40 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:59.509464 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-07e28a83-2174-4af3-9a98-bbc601829d40 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:59.903595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:59.913431 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:59.915368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:59.916666 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-520391b1-0a86-44e9-b9bd-c2bad264c519 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.476144 Jun 23 10:53:59.917324 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 291/554] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:53:59 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:53:59.939151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-07e28a83-2174-4af3-9a98-bbc601829d40 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:53:59.947355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-07e28a83-2174-4af3-9a98-bbc601829d40 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.452954 Jun 23 10:53:59.948045 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 264/555] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:53:59 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:54:00.456147 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-713cd083-99ab-44c4-981e-04b73c260ab3 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:00.456698 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-713cd083-99ab-44c4-981e-04b73c260ab3 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:00.462405 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-713cd083-99ab-44c4-981e-04b73c260ab3 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:00.462854 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-713cd083-99ab-44c4-981e-04b73c260ab3 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:00.463609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-713cd083-99ab-44c4-981e-04b73c260ab3 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:00.464032 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-713cd083-99ab-44c4-981e-04b73c260ab3 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:00.604640 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-713cd083-99ab-44c4-981e-04b73c260ab3 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:00.613062 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-713cd083-99ab-44c4-981e-04b73c260ab3 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1504 microversion: 2.1 time: 0.160345 Jun 23 10:54:00.613781 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 292/556] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:00 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:00.651240 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-913927835", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66f9eed7-b9a6-4658-b62c-bb41bfa6807b"}], "security_groups": [{"name": "tempest-securitygroup--1153589452"}], "key_name": "tempest-keypair-1270310407", "user_data": "}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:00.759462 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] validate_networks() for [('66f9eed7-b9a6-4658-b62c-bb41bfa6807b', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:54:00.935510 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:00.936219 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:00.943619 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:00.944069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:00.944840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:00.945268 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:01.151963 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:01.159836 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:01.161324 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:01.162518 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7e609093-480b-481e-b221-042bd125ca0e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.230831 Jun 23 10:54:01.163081 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 293/557] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:00 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:54:01.167368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fda3254d-15a8-480d-87fa-aa41a82a6de0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:01.167996 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fda3254d-15a8-480d-87fa-aa41a82a6de0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:01.173625 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fda3254d-15a8-480d-87fa-aa41a82a6de0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:01.174070 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fda3254d-15a8-480d-87fa-aa41a82a6de0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:01.176258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fda3254d-15a8-480d-87fa-aa41a82a6de0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:01.176696 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fda3254d-15a8-480d-87fa-aa41a82a6de0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:01.210071 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:54:01.210592 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:54:01.211125 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:54:01.211629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:54:01.212032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:54:01.220947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:01.221419 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:01.222205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:01.222656 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:01.239673 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for project 2123ff10502044b9aea48720440c2291. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:54:01.243598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for user eb8df5670686403480cdfd32ac408945 and project 2123ff10502044b9aea48720440c2291. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:54:01.255259 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:54:01.257501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:54:01.310156 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-398b6372-4bfa-4ec9-b821-73444d1654d2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.663233 Jun 23 10:54:01.311395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 265/558] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:54:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:54:01.323381 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0f73e428-17a5-4f8d-8e0d-2b393eb799d4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:01.324503 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-0f73e428-17a5-4f8d-8e0d-2b393eb799d4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:01.325631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fda3254d-15a8-480d-87fa-aa41a82a6de0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:01.363724 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fda3254d-15a8-480d-87fa-aa41a82a6de0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.199546 Jun 23 10:54:01.364310 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 294/559] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:01 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:01.381200 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-0f73e428-17a5-4f8d-8e0d-2b393eb799d4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:01.389787 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0f73e428-17a5-4f8d-8e0d-2b393eb799d4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1241 microversion: 2.1 time: 0.071900 Jun 23 10:54:01.390623 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 266/560] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:01 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:54:01.631938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-231696d1-7509-4253-9031-3d98bf9b3425 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:01.633182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-231696d1-7509-4253-9031-3d98bf9b3425 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:01.639526 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-231696d1-7509-4253-9031-3d98bf9b3425 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:01.640180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-231696d1-7509-4253-9031-3d98bf9b3425 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:01.641023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-231696d1-7509-4253-9031-3d98bf9b3425 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:01.641555 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-231696d1-7509-4253-9031-3d98bf9b3425 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:01.780170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-231696d1-7509-4253-9031-3d98bf9b3425 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:01.787607 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-4fb8398a-e156-4363-969e-130de6e6a838 req-25b68c57-c10d-4c90-8c26-b72ae0702573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a", "name": "network-vif-deleted", "tag": "bdf6ebc0-baa7-46dd-ac91-4a21f914e3d7"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:01.788347 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-231696d1-7509-4253-9031-3d98bf9b3425 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1504 microversion: 2.1 time: 0.161272 Jun 23 10:54:01.788899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 295/561] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:01 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:01.802009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-4fb8398a-e156-4363-969e-130de6e6a838 req-25b68c57-c10d-4c90-8c26-b72ae0702573 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:01.802488 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-4fb8398a-e156-4363-969e-130de6e6a838 req-25b68c57-c10d-4c90-8c26-b72ae0702573 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:01.812989 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-4fb8398a-e156-4363-969e-130de6e6a838 req-25b68c57-c10d-4c90-8c26-b72ae0702573 service nova] Creating event network-vif-deleted:bdf6ebc0-baa7-46dd-ac91-4a21f914e3d7 for instance e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a on hv-cinder-84614 Jun 23 10:54:01.818949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-4fb8398a-e156-4363-969e-130de6e6a838 req-25b68c57-c10d-4c90-8c26-b72ae0702573 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035739 Jun 23 10:54:01.819508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 267/562] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:54:02.182151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:02.182629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:02.193580 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:02.194023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:02.194823 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:02.195249 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:02.334725 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:02.337032 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:02.345133 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:02.347566 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:02.348836 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-751e7332-d155-475c-83fa-ee1e179e16b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.171633 Jun 23 10:54:02.349385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 296/563] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:02 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:54:02.381391 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-40ebcc0d-f1bc-4972-8a37-f5df9bf68d02 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:02.382110 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-40ebcc0d-f1bc-4972-8a37-f5df9bf68d02 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:02.388509 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-40ebcc0d-f1bc-4972-8a37-f5df9bf68d02 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:02.388952 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-40ebcc0d-f1bc-4972-8a37-f5df9bf68d02 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:02.389709 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-40ebcc0d-f1bc-4972-8a37-f5df9bf68d02 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:02.390139 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-40ebcc0d-f1bc-4972-8a37-f5df9bf68d02 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:02.407636 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d3ceb0cc-e833-4870-8e3f-a393d868b3cb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:02.408355 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d3ceb0cc-e833-4870-8e3f-a393d868b3cb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:02.414466 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3ceb0cc-e833-4870-8e3f-a393d868b3cb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:02.414988 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3ceb0cc-e833-4870-8e3f-a393d868b3cb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:02.415823 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3ceb0cc-e833-4870-8e3f-a393d868b3cb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:02.416348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3ceb0cc-e833-4870-8e3f-a393d868b3cb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:02.485193 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d3ceb0cc-e833-4870-8e3f-a393d868b3cb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:02.492696 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d3ceb0cc-e833-4870-8e3f-a393d868b3cb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1293 microversion: 2.1 time: 0.089096 Jun 23 10:54:02.493260 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 297/564] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:02 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:54:02.548412 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-40ebcc0d-f1bc-4972-8a37-f5df9bf68d02 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:02.557280 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-40ebcc0d-f1bc-4972-8a37-f5df9bf68d02 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1266 microversion: 2.1 time: 0.180763 Jun 23 10:54:02.557836 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 268/565] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:02 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:02.805203 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:02.805768 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:02.811672 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:02.812113 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:02.812892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:02.813322 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:02.850190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:02.850711 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:02.851110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lazy-loading 'fault' on Instance uuid e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:54:02.895510 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba1d9d9fe3c4f93b5caa347997814b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d03af3f8904c829e5a04755f7e3c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:02.902956 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-79398bbb-9dea-4e6c-9e46-2017513333e9 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 200 len: 1303 microversion: 2.1 time: 0.101508 Jun 23 10:54:02.903519 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 298/566] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:02 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:03.367320 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:03.367949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:03.374004 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.374475 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.375238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.375672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.510075 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-98fc2ebd-f0cd-4ba0-8a47-56bec6d7799e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:03.510945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:03.511301 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-98fc2ebd-f0cd-4ba0-8a47-56bec6d7799e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:03.513579 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:03.519241 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-98fc2ebd-f0cd-4ba0-8a47-56bec6d7799e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.519690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-98fc2ebd-f0cd-4ba0-8a47-56bec6d7799e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.520461 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-98fc2ebd-f0cd-4ba0-8a47-56bec6d7799e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.520893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-98fc2ebd-f0cd-4ba0-8a47-56bec6d7799e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.530815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:03.532305 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:03.533455 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8d6252a0-3173-46a0-84f0-68e3bf8dbb4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.170331 Jun 23 10:54:03.534621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 269/567] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:03 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:03.574854 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-258a4b5d-5c47-4d81-90ec-e6eaa4f0be78 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:03.575560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-258a4b5d-5c47-4d81-90ec-e6eaa4f0be78 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:03.584151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-258a4b5d-5c47-4d81-90ec-e6eaa4f0be78 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.584600 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-258a4b5d-5c47-4d81-90ec-e6eaa4f0be78 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.584730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-98fc2ebd-f0cd-4ba0-8a47-56bec6d7799e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:03.585370 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-258a4b5d-5c47-4d81-90ec-e6eaa4f0be78 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.585831 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-258a4b5d-5c47-4d81-90ec-e6eaa4f0be78 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.592199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-98fc2ebd-f0cd-4ba0-8a47-56bec6d7799e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1293 microversion: 2.1 time: 0.086239 Jun 23 10:54:03.592726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 299/568] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:03 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:54:03.718090 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-258a4b5d-5c47-4d81-90ec-e6eaa4f0be78 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:03.725684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-258a4b5d-5c47-4d81-90ec-e6eaa4f0be78 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1453 microversion: 2.1 time: 0.155090 Jun 23 10:54:03.726248 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 270/569] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:03 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:54:03.742225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-14e893d1-d294-4dbe-9fd9-37ec73bafd11 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:03.742870 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-14e893d1-d294-4dbe-9fd9-37ec73bafd11 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:03.748865 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14e893d1-d294-4dbe-9fd9-37ec73bafd11 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.749313 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14e893d1-d294-4dbe-9fd9-37ec73bafd11 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.750067 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14e893d1-d294-4dbe-9fd9-37ec73bafd11 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.750564 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14e893d1-d294-4dbe-9fd9-37ec73bafd11 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.882731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-14e893d1-d294-4dbe-9fd9-37ec73bafd11 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:03.890252 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-14e893d1-d294-4dbe-9fd9-37ec73bafd11 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1453 microversion: 2.1 time: 0.151753 Jun 23 10:54:03.890845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 300/570] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:03 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:03.920897 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:03.921698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] [instance: e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:03.928987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.929483 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.930530 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:03.930779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:03.946736 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] HTTP exception thrown: Instance e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a could not be found. Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Request method failure captured: Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a HTTP/1.1 Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEYGqstZ8x0RtUl6LoGAnAuf_ORNXqg6uxzCre9fErqBssybNMJHR5EFdi0hZbEptdd6_3ktPYGYbO1_nMGgzNmH_P8kqm4OE2XiJBY9HcilEyJ6RkJg5gGzQU_lCvsUah3Ttth-jDfgWoSMxqG8KMg2qAGw-eVUKz3ClbW2kkeIshg Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 33d03af3f8904c829e5a04755f7e3c1b Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesActionsTest-1290874327 Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:54:03.948371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/33d03af3f8904c829e5a04755f7e3c1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/33d03af3f8904c829e5a04755f7e3c1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_33d03af3f8904c829e5a04755f7e3c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/33d03af3f8904c829e5a04755f7e3c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesActionsTest-1290874327 Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 33d03af3f8904c829e5a04755f7e3c1b Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesActionsTest-1290874327 Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesActionsTest-1290874327-project Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: 9ba1d9d9fe3c4f93b5caa347997814b2 Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesActionsTest-1290874327-project Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a could not be found. Jun 23 10:54:03.950204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': 'e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a'} Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a could not be found. Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:54:03.951149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a could not be found. Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a could not be found. Jun 23 10:54:03.952583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:54:03.953913 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] Returning 404 to user: Instance e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:54:03.953913 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-176b97a0-6278-4fbe-90f4-eef632145f42 tempest-VolumesActionsTest-1290874327 tempest-VolumesActionsTest-1290874327-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a" status: 404 len: 111 microversion: 2.1 time: 0.033837 Jun 23 10:54:03.959517 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 271/571] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:03 2022] GET /compute/v2.1/servers/e8ff2e0d-8cf8-4abd-ba54-c7f9445b066a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:54:04.554534 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:04.555541 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:04.569149 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:04.569691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:04.570707 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:04.571238 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:04.611186 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-962b9dd7-c88a-4938-ad52-e3031fd2c80a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:04.613593 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-962b9dd7-c88a-4938-ad52-e3031fd2c80a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:04.623757 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-962b9dd7-c88a-4938-ad52-e3031fd2c80a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:04.624501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-962b9dd7-c88a-4938-ad52-e3031fd2c80a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:04.625690 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-962b9dd7-c88a-4938-ad52-e3031fd2c80a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:04.626561 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-962b9dd7-c88a-4938-ad52-e3031fd2c80a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:04.758093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-962b9dd7-c88a-4938-ad52-e3031fd2c80a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:04.765521 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-962b9dd7-c88a-4938-ad52-e3031fd2c80a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1299 microversion: 2.1 time: 0.159805 Jun 23 10:54:04.766749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 272/572] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:04 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:54:04.914559 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:04.923216 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:04.925216 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:04.926528 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8e06e64b-aa7a-44cd-858c-29dc4d43b3d7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.378084 Jun 23 10:54:04.927091 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 301/573] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:04 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:05.783339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e61a5959-c9cb-4569-a2d4-bcbfbd4ffbdb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:05.784707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e61a5959-c9cb-4569-a2d4-bcbfbd4ffbdb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:05.791327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e61a5959-c9cb-4569-a2d4-bcbfbd4ffbdb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:05.791770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e61a5959-c9cb-4569-a2d4-bcbfbd4ffbdb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:05.792550 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e61a5959-c9cb-4569-a2d4-bcbfbd4ffbdb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:05.792985 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e61a5959-c9cb-4569-a2d4-bcbfbd4ffbdb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:05.945645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:05.946399 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:05.952712 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:05.953158 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:05.953915 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:05.954367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:05.983194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e61a5959-c9cb-4569-a2d4-bcbfbd4ffbdb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:05.991638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e61a5959-c9cb-4569-a2d4-bcbfbd4ffbdb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.212438 Jun 23 10:54:05.992217 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 273/574] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:05 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:06.156379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-e08137c2-0424-45fa-934b-7b4fee99d44b req-7a593332-6316-4fa3-8ef7-52e128aab16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b963bbb2-e54a-4996-82eb-ab728b7f94d4", "tag": "e1aeaec1-0538-4618-bebe-dcb4ef7dba29"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:06.156796 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:06.164737 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-e08137c2-0424-45fa-934b-7b4fee99d44b req-7a593332-6316-4fa3-8ef7-52e128aab16b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:06.165175 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-e08137c2-0424-45fa-934b-7b4fee99d44b req-7a593332-6316-4fa3-8ef7-52e128aab16b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:06.165986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:06.167580 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:06.168971 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-daeb45c0-9f6e-43cb-a15f-928c72c3daf3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.227279 Jun 23 10:54:06.169682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 302/575] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:05 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:54:06.177026 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-e08137c2-0424-45fa-934b-7b4fee99d44b req-7a593332-6316-4fa3-8ef7-52e128aab16b service nova] Creating event network-changed:e1aeaec1-0538-4618-bebe-dcb4ef7dba29 for instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 on hv-cinder-84614 Jun 23 10:54:06.181894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-e08137c2-0424-45fa-934b-7b4fee99d44b req-7a593332-6316-4fa3-8ef7-52e128aab16b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029638 Jun 23 10:54:06.182499 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 274/576] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:54:07.008854 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-22b23826-8cab-4dac-88f7-50dbc323c6cd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:07.009458 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-22b23826-8cab-4dac-88f7-50dbc323c6cd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:07.015427 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22b23826-8cab-4dac-88f7-50dbc323c6cd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:07.015889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22b23826-8cab-4dac-88f7-50dbc323c6cd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:07.016643 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22b23826-8cab-4dac-88f7-50dbc323c6cd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:07.017072 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22b23826-8cab-4dac-88f7-50dbc323c6cd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:07.150553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-22b23826-8cab-4dac-88f7-50dbc323c6cd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:07.157994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-22b23826-8cab-4dac-88f7-50dbc323c6cd tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.153479 Jun 23 10:54:07.158579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 303/577] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:07 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:07.187849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:07.188526 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:07.195079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:07.195517 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:07.196268 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:07.196871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:07.329473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:07.337599 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:07.339169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:07.340316 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-cd8a51e6-39c4-4b85-ac21-36abc4ecb575 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.157101 Jun 23 10:54:07.340857 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 275/578] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:07 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:08.175411 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9b7190a7-b8cc-46ed-8e1f-3a86132d5224 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:08.176072 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9b7190a7-b8cc-46ed-8e1f-3a86132d5224 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:08.182000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b7190a7-b8cc-46ed-8e1f-3a86132d5224 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:08.182473 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b7190a7-b8cc-46ed-8e1f-3a86132d5224 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:08.183231 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b7190a7-b8cc-46ed-8e1f-3a86132d5224 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:08.183656 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b7190a7-b8cc-46ed-8e1f-3a86132d5224 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:08.313046 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9b7190a7-b8cc-46ed-8e1f-3a86132d5224 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:08.320800 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9b7190a7-b8cc-46ed-8e1f-3a86132d5224 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.149335 Jun 23 10:54:08.321494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 304/579] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:08 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:08.358064 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:08.358824 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:08.366716 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:08.366716 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:08.367419 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:08.367845 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:08.523653 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:08.532205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:08.533843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:08.535142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-dfa0d99f-c7e4-43cf-8f8f-c37fbcff89b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.181044 Jun 23 10:54:08.535770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 276/580] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:08 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:08.615927 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-8001a4fd-bc6e-41d4-90da-0bca005324b7 req-f3fb4724-fe19-4089-afd9-7156428f1a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2112b96a-009d-4c3d-90ac-aaa4acd04593", "tag": "9a379fae-31ed-47bf-8eb6-88ddcd9023c7"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:08.625525 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-8001a4fd-bc6e-41d4-90da-0bca005324b7 req-f3fb4724-fe19-4089-afd9-7156428f1a33 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:08.625969 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-8001a4fd-bc6e-41d4-90da-0bca005324b7 req-f3fb4724-fe19-4089-afd9-7156428f1a33 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:08.638394 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-8001a4fd-bc6e-41d4-90da-0bca005324b7 req-f3fb4724-fe19-4089-afd9-7156428f1a33 service nova] Creating event network-changed:9a379fae-31ed-47bf-8eb6-88ddcd9023c7 for instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 on hv-cinder-84614 Jun 23 10:54:08.643848 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-8001a4fd-bc6e-41d4-90da-0bca005324b7 req-f3fb4724-fe19-4089-afd9-7156428f1a33 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034055 Jun 23 10:54:08.644635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 305/581] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:54:09.337669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-372d05b4-0de9-4125-9adc-c2802cbeb8bb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:09.338299 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-372d05b4-0de9-4125-9adc-c2802cbeb8bb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:09.344344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-372d05b4-0de9-4125-9adc-c2802cbeb8bb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:09.344781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-372d05b4-0de9-4125-9adc-c2802cbeb8bb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:09.345626 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-372d05b4-0de9-4125-9adc-c2802cbeb8bb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:09.345953 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-372d05b4-0de9-4125-9adc-c2802cbeb8bb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:09.476575 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-372d05b4-0de9-4125-9adc-c2802cbeb8bb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:09.484156 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-372d05b4-0de9-4125-9adc-c2802cbeb8bb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.150256 Jun 23 10:54:09.484817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 277/582] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:09 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:09.550989 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=4 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:09.555459 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:09.556146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:09.562695 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:09.563146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:09.563908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:09.564338 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:09.696587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:09.704624 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:09.706203 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:09.707359 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7292d2b8-2be8-4a51-9fca-25d5502e0997 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.158126 Jun 23 10:54:09.707909 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 306/583] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:09 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:10.502417 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7dd4d3bb-335e-4f4e-afe9-636edfc2428b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:10.503285 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7dd4d3bb-335e-4f4e-afe9-636edfc2428b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:10.509349 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7dd4d3bb-335e-4f4e-afe9-636edfc2428b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:10.509774 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7dd4d3bb-335e-4f4e-afe9-636edfc2428b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:10.510550 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7dd4d3bb-335e-4f4e-afe9-636edfc2428b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:10.510973 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7dd4d3bb-335e-4f4e-afe9-636edfc2428b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:10.638188 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7dd4d3bb-335e-4f4e-afe9-636edfc2428b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:10.648724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7dd4d3bb-335e-4f4e-afe9-636edfc2428b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.150244 Jun 23 10:54:10.654555 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 278/584] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:10 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:10.726097 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:10.726882 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:10.733027 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:10.733466 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:10.734223 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:10.734685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:10.870145 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:10.880853 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:10.883123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:10.885142 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-cb2365b5-0a68-40f4-b229-5f2b81abca0f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.163822 Jun 23 10:54:10.886227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 307/585] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:10 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:11.673231 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-16095345-14c8-4a59-907c-c3cbb6bb757d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:11.673913 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-16095345-14c8-4a59-907c-c3cbb6bb757d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:11.676534 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:11.677331 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=8 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:11.696705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-16095345-14c8-4a59-907c-c3cbb6bb757d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:11.698005 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-16095345-14c8-4a59-907c-c3cbb6bb757d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:11.700190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-16095345-14c8-4a59-907c-c3cbb6bb757d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:11.701094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-16095345-14c8-4a59-907c-c3cbb6bb757d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:11.877089 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-16095345-14c8-4a59-907c-c3cbb6bb757d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:11.895314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-16095345-14c8-4a59-907c-c3cbb6bb757d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.230832 Jun 23 10:54:11.910136 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:11.911472 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:11.914709 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 279/586] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:11 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:11.918829 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:11.919863 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:11.920802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:11.921460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:12.115319 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:12.124296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:12.126087 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:12.128260 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f7b0976e-bddc-4c55-bacc-5ce47edc37a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.222058 Jun 23 10:54:12.128786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 308/587] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:11 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:12.912736 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1b1d1e54-0744-4c50-8034-4a047a763372 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:12.913461 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1b1d1e54-0744-4c50-8034-4a047a763372 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:12.920165 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b1d1e54-0744-4c50-8034-4a047a763372 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:12.920688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b1d1e54-0744-4c50-8034-4a047a763372 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:12.921524 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b1d1e54-0744-4c50-8034-4a047a763372 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:12.922205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1b1d1e54-0744-4c50-8034-4a047a763372 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:13.077776 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1b1d1e54-0744-4c50-8034-4a047a763372 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:13.087264 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1b1d1e54-0744-4c50-8034-4a047a763372 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.178933 Jun 23 10:54:13.087885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 280/588] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:12 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:13.147478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:13.148850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:13.155195 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:13.155945 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:13.156721 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:13.157161 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:13.315344 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:13.328796 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:13.332458 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:13.333954 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-cdab8c8d-181c-4d6d-a650-887d82bb7d67 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.191463 Jun 23 10:54:13.334551 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 309/589] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:13 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:14.109425 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b0d4de80-b777-4ad4-b795-b7bfdbe1777a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:14.110898 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b0d4de80-b777-4ad4-b795-b7bfdbe1777a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:14.118803 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0d4de80-b777-4ad4-b795-b7bfdbe1777a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:14.119644 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0d4de80-b777-4ad4-b795-b7bfdbe1777a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:14.120688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0d4de80-b777-4ad4-b795-b7bfdbe1777a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:14.121637 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b0d4de80-b777-4ad4-b795-b7bfdbe1777a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:14.270231 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b0d4de80-b777-4ad4-b795-b7bfdbe1777a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:14.279180 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b0d4de80-b777-4ad4-b795-b7bfdbe1777a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.173657 Jun 23 10:54:14.280330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 281/590] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:14 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:14.352610 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:14.353856 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:14.361385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:14.362593 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:14.363581 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:14.364171 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:14.513605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:14.527234 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:14.528809 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:14.530072 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f9b11646-9fc7-4c81-9e99-6485a19ee625 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.181383 Jun 23 10:54:14.530858 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 310/591] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:14 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:15.297052 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e9a5eab1-58a6-4653-bbb9-141c0575c203 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:15.297680 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e9a5eab1-58a6-4653-bbb9-141c0575c203 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:15.312851 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e9a5eab1-58a6-4653-bbb9-141c0575c203 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:15.313822 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e9a5eab1-58a6-4653-bbb9-141c0575c203 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:15.315994 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e9a5eab1-58a6-4653-bbb9-141c0575c203 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:15.316894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e9a5eab1-58a6-4653-bbb9-141c0575c203 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:15.488362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e9a5eab1-58a6-4653-bbb9-141c0575c203 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:15.497406 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e9a5eab1-58a6-4653-bbb9-141c0575c203 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.204418 Jun 23 10:54:15.497986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 282/592] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:15 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:15.548967 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:15.551030 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:15.552993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:15.559046 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:15.560005 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:15.561016 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:15.561512 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:15.725345 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:15.734289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:15.735936 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:15.737222 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7afdedf0-377b-4fc6-9c13-569fd472f5c7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.192166 Jun 23 10:54:15.737864 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 311/593] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:15 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:16.366500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-5f76600e-7b97-4200-b450-69bb2d4c5a7b req-989635fd-b77f-4164-ac28-f40f7f56bfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2112b96a-009d-4c3d-90ac-aaa4acd04593", "name": "network-vif-plugged", "status": "completed", "tag": "9a379fae-31ed-47bf-8eb6-88ddcd9023c7"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:16.376306 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-5f76600e-7b97-4200-b450-69bb2d4c5a7b req-989635fd-b77f-4164-ac28-f40f7f56bfe1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:16.376954 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-5f76600e-7b97-4200-b450-69bb2d4c5a7b req-989635fd-b77f-4164-ac28-f40f7f56bfe1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:16.396195 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-5f76600e-7b97-4200-b450-69bb2d4c5a7b req-989635fd-b77f-4164-ac28-f40f7f56bfe1 service nova] Creating event network-vif-plugged:9a379fae-31ed-47bf-8eb6-88ddcd9023c7 for instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 on hv-cinder-84614 Jun 23 10:54:16.429635 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-5f76600e-7b97-4200-b450-69bb2d4c5a7b req-989635fd-b77f-4164-ac28-f40f7f56bfe1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066711 Jun 23 10:54:16.432296 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 283/594] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:54:16.516629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2ae67ee5-678e-49d5-9093-36898702d5af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:16.517591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2ae67ee5-678e-49d5-9093-36898702d5af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:16.525329 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2ae67ee5-678e-49d5-9093-36898702d5af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:16.526691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2ae67ee5-678e-49d5-9093-36898702d5af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:16.527906 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2ae67ee5-678e-49d5-9093-36898702d5af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:16.527906 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2ae67ee5-678e-49d5-9093-36898702d5af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:16.701599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2ae67ee5-678e-49d5-9093-36898702d5af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:16.715029 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2ae67ee5-678e-49d5-9093-36898702d5af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.201041 Jun 23 10:54:16.716359 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 312/595] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:16 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:54:16.757898 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:16.758653 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:16.765675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:16.766121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:16.767111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:16.767544 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:16.930917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:16.942523 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:16.944472 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:16.945861 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2ce506b6-936e-4b61-87c4-9fb8021c24cb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.194094 Jun 23 10:54:16.946957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 284/596] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:16 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:17.733171 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-200162b8-6737-425a-ba48-d6c4f97a6943 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:17.733760 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-200162b8-6737-425a-ba48-d6c4f97a6943 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:17.740475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-200162b8-6737-425a-ba48-d6c4f97a6943 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:17.740930 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-200162b8-6737-425a-ba48-d6c4f97a6943 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:17.741695 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-200162b8-6737-425a-ba48-d6c4f97a6943 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:17.742121 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-200162b8-6737-425a-ba48-d6c4f97a6943 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:17.886249 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-200162b8-6737-425a-ba48-d6c4f97a6943 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:17.888760 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=100 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:17.895896 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-200162b8-6737-425a-ba48-d6c4f97a6943 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.166629 Jun 23 10:54:17.896675 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 313/597] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:17 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:17.964839 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:17.965621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:17.973279 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:17.973840 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:17.974879 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:17.975312 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:18.141921 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:18.155436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:18.157765 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:18.159038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-14e364ce-3868-4b26-a3e0-809a4ecb36bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1743 microversion: 2.20 time: 0.198267 Jun 23 10:54:18.174955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 285/598] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:17 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1743 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:18.914928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-73a0a5c2-9762-4931-956f-b8e33fde3d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:18.916840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-73a0a5c2-9762-4931-956f-b8e33fde3d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:18.923872 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-73a0a5c2-9762-4931-956f-b8e33fde3d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:18.925228 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-73a0a5c2-9762-4931-956f-b8e33fde3d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:18.926015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-73a0a5c2-9762-4931-956f-b8e33fde3d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:18.926478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-73a0a5c2-9762-4931-956f-b8e33fde3d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:19.104603 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-73a0a5c2-9762-4931-956f-b8e33fde3d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:19.113363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-73a0a5c2-9762-4931-956f-b8e33fde3d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1367 microversion: 2.1 time: 0.202625 Jun 23 10:54:19.114256 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 314/599] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:18 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:54:19.183952 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:19.184533 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:19.192574 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:19.193022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:19.193790 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:19.194216 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:19.335990 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:19.365993 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:19.367547 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:19.368857 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9b21952c-61dc-4418-86a1-8493f185cf05 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1743 microversion: 2.20 time: 0.188858 Jun 23 10:54:19.369405 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 286/600] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:19 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:20.131931 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-37b7593b-ae1e-4d96-81e0-8026b6497666 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:20.132867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-37b7593b-ae1e-4d96-81e0-8026b6497666 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:20.140157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37b7593b-ae1e-4d96-81e0-8026b6497666 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:20.140927 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37b7593b-ae1e-4d96-81e0-8026b6497666 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:20.141786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37b7593b-ae1e-4d96-81e0-8026b6497666 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:20.142492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37b7593b-ae1e-4d96-81e0-8026b6497666 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:20.329318 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-37b7593b-ae1e-4d96-81e0-8026b6497666 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:20.339928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-37b7593b-ae1e-4d96-81e0-8026b6497666 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1557 microversion: 2.1 time: 0.212904 Jun 23 10:54:20.342380 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 315/601] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:54:20 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:54:20.357043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5b7a9b7c-4f55-4e76-802a-034d6b5ebad4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:20.357667 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5b7a9b7c-4f55-4e76-802a-034d6b5ebad4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:20.365843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5b7a9b7c-4f55-4e76-802a-034d6b5ebad4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:20.366693 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5b7a9b7c-4f55-4e76-802a-034d6b5ebad4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:20.367477 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5b7a9b7c-4f55-4e76-802a-034d6b5ebad4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:20.367909 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5b7a9b7c-4f55-4e76-802a-034d6b5ebad4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:20.388844 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:20.389454 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:20.399872 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:20.400383 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:20.401106 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:20.401542 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:20.545830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5b7a9b7c-4f55-4e76-802a-034d6b5ebad4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192725 Jun 23 10:54:20.553847 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 287/602] 10.222.0.39 () {58 vars in 1274 bytes} [Thu Jun 23 10:54:20 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:54:20.553847 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-907ed77a-4cd0-4a04-bab8-bee47489f61c req-46829a31-66d7-4e55-b8cb-d3a8f4498dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737a2c37-15f8-4f42-a879-af5af910fd30", "name": "network-vif-plugged", "status": "completed", "tag": "025ad83b-3dde-441a-ae8a-ae243337df1c"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:20.567294 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-907ed77a-4cd0-4a04-bab8-bee47489f61c req-46829a31-66d7-4e55-b8cb-d3a8f4498dda service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:20.568641 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-907ed77a-4cd0-4a04-bab8-bee47489f61c req-46829a31-66d7-4e55-b8cb-d3a8f4498dda service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:20.582730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-907ed77a-4cd0-4a04-bab8-bee47489f61c req-46829a31-66d7-4e55-b8cb-d3a8f4498dda service nova] Creating event network-vif-plugged:025ad83b-3dde-441a-ae8a-ae243337df1c for instance 737a2c37-15f8-4f42-a879-af5af910fd30 on hv-cinder-84614 Jun 23 10:54:20.588812 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-907ed77a-4cd0-4a04-bab8-bee47489f61c req-46829a31-66d7-4e55-b8cb-d3a8f4498dda service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040640 Jun 23 10:54:20.590107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 288/603] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:54:20.994182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:21.004110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:21.010586 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:21.011805 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-08f2240c-a9ad-4971-be7f-230460cf1e7f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1743 microversion: 2.20 time: 0.627862 Jun 23 10:54:21.012355 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 316/604] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:20 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1743 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:54:21.915930 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-4e11faf5-a3a1-42e9-9c94-b9e6a7631035 req-bbef04fd-41b3-400a-b8fa-39f95eaa5bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2112b96a-009d-4c3d-90ac-aaa4acd04593", "tag": "9a379fae-31ed-47bf-8eb6-88ddcd9023c7"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:21.928385 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-4e11faf5-a3a1-42e9-9c94-b9e6a7631035 req-bbef04fd-41b3-400a-b8fa-39f95eaa5bb9 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:21.929188 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-4e11faf5-a3a1-42e9-9c94-b9e6a7631035 req-bbef04fd-41b3-400a-b8fa-39f95eaa5bb9 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:21.945712 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-4e11faf5-a3a1-42e9-9c94-b9e6a7631035 req-bbef04fd-41b3-400a-b8fa-39f95eaa5bb9 service nova] Creating event network-changed:9a379fae-31ed-47bf-8eb6-88ddcd9023c7 for instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 on hv-cinder-84614 Jun 23 10:54:21.967211 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-4e11faf5-a3a1-42e9-9c94-b9e6a7631035 req-bbef04fd-41b3-400a-b8fa-39f95eaa5bb9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055668 Jun 23 10:54:21.968566 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 289/605] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:54:22.032236 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:22.037858 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:22.045352 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:22.046059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:22.048018 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:22.048675 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:22.251940 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:22.260493 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:22.262416 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:22.263802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-06623244-2d06-4168-a351-6c85d31f9085 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1743 microversion: 2.20 time: 0.236001 Jun 23 10:54:22.264722 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 317/606] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:22 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:23.284473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:23.285630 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:23.297031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:23.297820 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:23.299137 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:23.299771 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:23.324780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:23.494301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:23.503701 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:23.505365 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:23.506652 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-746f2e58-6dbc-4578-aee0-5396d502a178 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1743 microversion: 2.20 time: 0.227215 Jun 23 10:54:23.507573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 290/607] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:23 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1743 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:24.529349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:24.530854 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:24.538945 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:24.539658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:24.540587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:24.541178 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:24.710275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:24.719388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:24.722127 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:24.724439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4037a094-6447-4356-ad76-3d4c231f47fb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1743 microversion: 2.20 time: 0.199113 Jun 23 10:54:24.725023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 318/608] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:24 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:25.759229 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:25.761735 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:25.779702 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:25.790231 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:25.791395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:25.792792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:25.793624 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:26.039325 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:26.049807 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:26.051604 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:26.053692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-485228b4-fbd6-4d99-8f99-6e2807094b64 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1738 microversion: 2.20 time: 0.299845 Jun 23 10:54:26.067729 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 291/609] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:25 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:27.079475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:27.080692 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:27.087281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:27.087728 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:27.088503 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:27.088938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:27.262024 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:27.272644 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:27.274138 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:27.275520 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0abf150e-0425-42c0-8ec1-495e40a355bf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1738 microversion: 2.20 time: 0.200065 Jun 23 10:54:27.276072 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 319/610] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:27 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:28.299451 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:28.300090 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:28.306540 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:28.306977 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:28.307851 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:28.308516 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:28.469448 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:28.479297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:28.480853 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:28.482379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b9919167-5ed2-46ff-8c4a-59aab6f2a618 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1738 microversion: 2.20 time: 0.187326 Jun 23 10:54:28.483174 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 292/611] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:28 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:29.504918 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:29.514916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:29.525690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:29.531345 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:29.532736 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:29.534117 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:29.758990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:29.767685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:29.770265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:29.771747 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-55a88b87-d594-4bf1-ad0a-898004db3b3a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1738 microversion: 2.20 time: 0.274454 Jun 23 10:54:29.772553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 320/612] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:29 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:30.790301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:30.790966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:30.798935 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:30.799756 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:30.800669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:30.801176 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:30.954857 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:30.964573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:30.966174 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:30.967432 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9fe16a11-1b8e-41a6-98dd-c7fc7eeae594 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1738 microversion: 2.20 time: 0.181080 Jun 23 10:54:30.968357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 293/613] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:30 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:31.986016 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:31.986630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:31.993556 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:31.994016 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:31.994842 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:31.995277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:32.150683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:32.160393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:32.161889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:32.163085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6106f776-a7ad-4670-817e-a54d92f21761 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1738 microversion: 2.20 time: 0.180999 Jun 23 10:54:32.163639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 321/614] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:31 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:33.181471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:33.182176 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:33.188886 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:33.189359 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:33.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:33.191291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:33.346869 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:33.355660 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:33.357164 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:33.358984 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c9a19e52-9a8a-44d8-944f-668cd76a07e5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1738 microversion: 2.20 time: 0.180943 Jun 23 10:54:33.370395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 294/615] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:33 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:34.378140 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:34.378784 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:34.385820 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:34.386271 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:34.387084 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:34.387603 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:34.534774 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:34.545541 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:34.547221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:34.548473 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-10128c05-c22e-49ba-b2dc-d6db9c08dcc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1738 microversion: 2.20 time: 0.175109 Jun 23 10:54:34.549516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 322/616] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:34 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:35.568436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:35.569032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:35.575840 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:35.576275 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:35.577024 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:35.577452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:35.704507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:35.712869 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:35.714366 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:35.715515 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8c68fa73-6179-4bbb-8db9-63615a73471b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1738 microversion: 2.20 time: 0.151688 Jun 23 10:54:35.716093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 295/617] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:35 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:36.733812 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:36.734379 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:36.740574 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:36.741023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:36.741784 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:36.742219 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:36.873344 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:36.881791 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:36.883437 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:36.884590 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d8379eed-8807-43d6-9560-9e9ae03857b8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1720 microversion: 2.20 time: 0.154739 Jun 23 10:54:36.885142 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 323/618] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:36 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:37.902339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:37.902963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:37.909317 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:37.909754 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:37.910548 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:37.910979 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:38.037982 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:38.045811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:38.047357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:38.048498 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-61a6aaa9-be7d-47c9-93f2-bc13c0906959 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1720 microversion: 2.20 time: 0.150069 Jun 23 10:54:38.049614 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 296/619] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:37 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:38.383019 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-06d39aa9-9d68-473d-9e84-9f444e4731c2 req-51752e36-7d84-4eab-a604-9baca9b0c8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737a2c37-15f8-4f42-a879-af5af910fd30", "name": "network-vif-unplugged", "status": "completed", "tag": "025ad83b-3dde-441a-ae8a-ae243337df1c"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:38.391553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-06d39aa9-9d68-473d-9e84-9f444e4731c2 req-51752e36-7d84-4eab-a604-9baca9b0c8f8 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:38.392003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-06d39aa9-9d68-473d-9e84-9f444e4731c2 req-51752e36-7d84-4eab-a604-9baca9b0c8f8 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:38.403988 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-06d39aa9-9d68-473d-9e84-9f444e4731c2 req-51752e36-7d84-4eab-a604-9baca9b0c8f8 service nova] Creating event network-vif-unplugged:025ad83b-3dde-441a-ae8a-ae243337df1c for instance 737a2c37-15f8-4f42-a879-af5af910fd30 on hv-cinder-84614 Jun 23 10:54:38.409269 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-06d39aa9-9d68-473d-9e84-9f444e4731c2 req-51752e36-7d84-4eab-a604-9baca9b0c8f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029782 Jun 23 10:54:38.409968 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 324/620] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:54:39.067723 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:39.068306 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:39.075125 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:39.075559 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:39.076302 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:39.076728 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:39.208155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:39.217123 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:39.218636 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:39.219792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d52d1442-d8df-431a-a1c7-34d89c523ba4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1663 microversion: 2.20 time: 0.156746 Jun 23 10:54:39.220341 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 297/621] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:39 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:39.241591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4bede6bb-94cf-4b07-bc62-bb4483750434 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0197af19-8059-493c-a4ab-36d642ac320e"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:39.242761 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4bede6bb-94cf-4b07-bc62-bb4483750434 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:39.248958 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4bede6bb-94cf-4b07-bc62-bb4483750434 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:39.249406 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4bede6bb-94cf-4b07-bc62-bb4483750434 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:39.250196 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4bede6bb-94cf-4b07-bc62-bb4483750434 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:39.250658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4bede6bb-94cf-4b07-bc62-bb4483750434 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:39.538106 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4bede6bb-94cf-4b07-bc62-bb4483750434 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300863 Jun 23 10:54:39.538810 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 325/622] 10.222.0.39 () {62 vars in 1363 bytes} [Thu Jun 23 10:54:39 2022] POST /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:54:39.653366 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-86076e15-b7cf-423d-aff9-5743c8013775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:54:39.653924 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-86076e15-b7cf-423d-aff9-5743c8013775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:39.660487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86076e15-b7cf-423d-aff9-5743c8013775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:39.660956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86076e15-b7cf-423d-aff9-5743c8013775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:39.661702 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86076e15-b7cf-423d-aff9-5743c8013775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:39.662128 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86076e15-b7cf-423d-aff9-5743c8013775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:39.750587 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-86076e15-b7cf-423d-aff9-5743c8013775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/action" status: 202 len: 0 microversion: 2.20 time: 0.101110 Jun 23 10:54:39.751357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 298/623] 10.222.0.39 () {62 vars in 1318 bytes} [Thu Jun 23 10:54:39 2022] POST /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:54:39.759462 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:39.760071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:39.766249 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:39.766746 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:39.768170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:39.768605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:39.902732 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:39.911094 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:39.912591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:39.913865 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6b365cb4-a324-4f10-bcdf-4a5b667c6c62 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1749 microversion: 2.20 time: 0.158342 Jun 23 10:54:39.924154 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 326/624] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:39 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:40.933339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:40.933948 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:40.940251 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:40.940699 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:40.941466 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:40.941903 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:41.071214 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:41.079726 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:41.081793 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:41.082974 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f6e13778-1752-44e1-a08e-72a48b2bc5c2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1751 microversion: 2.20 time: 0.154067 Jun 23 10:54:41.083527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 299/625] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:40 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:42.103832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:42.104460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:42.111484 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:42.111983 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:42.112840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:42.113277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:42.251405 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:42.260955 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:42.262497 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:42.263694 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1d924654-b684-4e64-9306-5582afb10631 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.165637 Jun 23 10:54:42.273704 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 327/626] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:42 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:43.283311 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:43.283859 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:43.290443 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:43.290915 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:43.291675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:43.292097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:43.431598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:43.440380 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:43.441854 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:43.443025 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-942842a8-85e3-4a65-82f6-4cf614c1c437 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.163874 Jun 23 10:54:43.443566 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 300/627] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:43 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:44.460950 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:44.461538 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:44.469622 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:44.470078 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:44.470932 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:44.471372 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:44.496107 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:44.609830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:44.618236 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:44.619775 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:44.620919 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e936cf94-b084-43d5-a9c9-1fbada44a9b3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.163943 Jun 23 10:54:44.621467 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 328/628] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:44 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:54:45.639916 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:45.640446 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:45.646849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:45.647294 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:45.648049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:45.648483 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:45.785263 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:45.793511 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:45.795047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:45.796173 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c7161b02-b5a8-42b9-9f3c-53a3dba3ce90 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.160207 Jun 23 10:54:45.796716 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 301/629] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:45 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:46.815899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:46.816502 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:46.818364 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=36 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:46.823929 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:46.824375 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:46.825423 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:46.825855 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:46.970497 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:46.982909 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:46.984502 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:46.985724 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d5878e2b-2275-45e2-b6f2-087e9430a889 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.174634 Jun 23 10:54:46.986732 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 329/630] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:46 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:48.005444 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:48.006027 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:48.012500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:48.012943 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:48.013688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:48.014116 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:48.153782 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:48.162521 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:48.164013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:48.165162 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ef05d704-65da-4e20-8bcc-026439dc945f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.164366 Jun 23 10:54:48.165707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 302/631] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:47 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:49.184515 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:49.185896 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:49.193614 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:49.194055 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:49.195213 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:49.195686 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:49.331051 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:49.340024 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:49.341517 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:49.342674 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-84dc1823-531c-44c7-b31b-2d886e76d020 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.162842 Jun 23 10:54:49.343810 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 330/632] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:49 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:50.363959 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:50.364570 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:50.370754 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:50.371279 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:50.372041 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:50.372448 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:50.527624 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:50.539444 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:50.539444 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:50.539858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-57bdb1a3-fa5f-42dc-9900-0e6a2cdd4ebe tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.180612 Jun 23 10:54:50.550902 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 303/633] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:50 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:51.560329 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:51.560932 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:51.569031 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:51.571384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:51.572885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:51.573753 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:51.711022 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:51.719349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:51.721553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:51.722738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-580628e1-0dd5-4814-87ce-a8713f84d880 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.167329 Jun 23 10:54:51.723287 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 331/634] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:51 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:52.741596 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:52.742192 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:52.748903 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:52.749415 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:52.750170 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:52.750627 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:52.946226 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:52.954971 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:52.956456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:52.957601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a9482dc9-b430-4465-b7a2-124168e85750 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.219907 Jun 23 10:54:52.958149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 304/635] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:52 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:53.976762 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:53.977393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:53.983595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:53.984034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:53.984785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:53.985212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:54.180338 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:54.188707 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:54.191034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:54.192234 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6ab5880d-4b68-4574-85b4-6ee4333423ed tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.219323 Jun 23 10:54:54.192784 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 332/636] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:53 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:55.211357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:55.212515 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:55.229827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:55.230305 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:55.231108 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:55.231594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:55.234409 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:55.394564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:55.403347 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:55.404854 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:55.405997 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-672e6e9b-d10a-4095-a5f3-0c2426b23ef5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.198778 Jun 23 10:54:55.406814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 305/637] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:55 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:56.424137 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:56.424737 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:56.430810 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:56.431254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:56.432008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:56.432437 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:56.566265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:56.574554 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:56.576289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:56.577428 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9e82c7bb-8917-42ee-a19c-4d6a42a835b5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.157453 Jun 23 10:54:56.577971 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 333/638] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:56 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:57.596084 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:57.596688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:57.599118 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=32 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:57.604429 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:57.604868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:57.605620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:57.606048 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:57.735549 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:57.744707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:57.746193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:57.747359 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7aae641d-b809-4823-be20-3c28ca8cf17e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.155552 Jun 23 10:54:57.747906 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 306/639] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:57 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:58.765360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:58.765992 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:58.772684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:58.773145 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:58.773899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:58.774347 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:58.906988 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:58.915225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:58.916702 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:54:58.917833 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-dd4f1d78-0afb-4234-bae3-60be751ee6f7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.156330 Jun 23 10:54:58.918404 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 334/640] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:58 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:54:59.935965 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:59.936568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:54:59.943442 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:59.943889 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:54:59.944648 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:54:59.945076 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:00.074530 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:00.083797 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:00.085286 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:00.086456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-42833d09-e62d-4953-b955-52b56f38f06a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.154335 Jun 23 10:55:00.087009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 307/641] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:54:59 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:01.110441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:01.111607 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:01.123698 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:01.124192 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:01.128311 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:01.129843 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:01.293755 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:01.302647 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:01.304121 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:01.305267 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-87cde4da-d3a5-4ba8-9cdc-66e292d47ea0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.203360 Jun 23 10:55:01.305819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 335/642] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:01 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:02.323771 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:02.324380 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:02.331733 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:02.332177 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:02.332932 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:02.333362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:02.465221 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:02.473783 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:02.475328 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:02.476479 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8bfb0c12-3215-4343-be97-19930120c2ce tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.156599 Jun 23 10:55:02.477029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 308/643] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:02 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:03.494945 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:03.495545 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:03.502475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:03.502884 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:03.503635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:03.504060 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:03.632219 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:03.640522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:03.642677 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:03.643955 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e190b903-8755-4c92-9112-6f991ac55acb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.152882 Jun 23 10:55:03.644505 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 336/644] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:03 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:55:04.662748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:04.663354 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:04.669721 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:04.670159 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:04.670935 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:04.671364 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:04.802608 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:04.811007 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:04.812505 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:04.814183 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c60be427-c1fa-401d-8962-510d9bd86e0b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.154872 Jun 23 10:55:04.814857 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 309/645] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:04 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:05.832349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:05.832971 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:05.838959 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:05.839398 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:05.840144 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:05.840572 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:06.059524 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:06.068403 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:06.069878 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:06.071057 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ee743d62-5e4c-49e2-8bf2-6b44294f017a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.242725 Jun 23 10:55:06.071630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 337/646] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:05 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:07.090111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:07.090766 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:07.098129 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:07.098637 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:07.099429 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:07.099866 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:07.230480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:07.239270 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:07.240735 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:07.241864 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6044c2cb-09e0-4a19-b4d4-74d87e9a890b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.155669 Jun 23 10:55:07.242434 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 310/647] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:07 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:08.259688 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:08.260373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:08.266721 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:08.267348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:08.268101 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:08.268523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:08.398394 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:08.407325 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:08.410097 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:08.411190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ef4fbd57-338a-4f5a-9000-76ba253ad522 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.155387 Jun 23 10:55:08.411745 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 338/648] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:08 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:09.429066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:09.429672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:09.436157 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:09.436602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:09.437355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:09.437788 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:09.567554 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:09.576051 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:09.577520 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:09.578684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f99a9e97-1600-4664-beec-f7a4fcd9e67e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.153433 Jun 23 10:55:09.579222 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 311/649] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:09 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:10.598226 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:10.598843 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:10.604961 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:10.605408 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:10.606176 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:10.606632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:10.736981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:10.745275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:10.746808 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:10.747966 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a273aa67-b0e2-4b6a-9f8f-fd141510a885 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.154715 Jun 23 10:55:10.748509 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 339/650] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:10 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:11.766238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:11.766908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:11.773219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:11.773698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:11.774473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:11.774910 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:11.900264 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:11.909238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:11.910753 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:11.911912 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2d89d30f-58fc-4d6b-9738-b86b3e4a69c4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.149590 Jun 23 10:55:11.912458 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 312/651] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:11 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:12.560143 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-be8082ad-b656-4697-9560-e9f7e9e158e5 req-20cfcd8f-d0c5-4d9d-8395-8784b58a81ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737a2c37-15f8-4f42-a879-af5af910fd30", "name": "network-vif-plugged", "status": "completed", "tag": "025ad83b-3dde-441a-ae8a-ae243337df1c"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:12.569892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-be8082ad-b656-4697-9560-e9f7e9e158e5 req-20cfcd8f-d0c5-4d9d-8395-8784b58a81ee service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:12.570367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-be8082ad-b656-4697-9560-e9f7e9e158e5 req-20cfcd8f-d0c5-4d9d-8395-8784b58a81ee service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:12.582479 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-be8082ad-b656-4697-9560-e9f7e9e158e5 req-20cfcd8f-d0c5-4d9d-8395-8784b58a81ee service nova] Creating event network-vif-plugged:025ad83b-3dde-441a-ae8a-ae243337df1c for instance 737a2c37-15f8-4f42-a879-af5af910fd30 on hv-cinder-84614 Jun 23 10:55:12.587480 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-be8082ad-b656-4697-9560-e9f7e9e158e5 req-20cfcd8f-d0c5-4d9d-8395-8784b58a81ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030918 Jun 23 10:55:12.588061 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 340/652] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:12.930093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:12.930730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:12.937245 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:12.937687 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:12.938469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:12.938962 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:13.072263 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:13.087482 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:13.088979 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:13.090153 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d263e158-754e-4da1-8ebe-262051cc272c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.163923 Jun 23 10:55:13.090899 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 313/653] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:12 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:14.109664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:14.110354 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:14.117008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:14.117434 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:14.118179 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:14.118638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:14.253164 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:14.261519 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:14.263065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:14.264205 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e339ca5a-af45-4c96-933e-a52a5a9359bc tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.158887 Jun 23 10:55:14.264747 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 341/654] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:14 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:15.283261 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:15.284025 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:15.290475 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:15.290924 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:15.291739 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:15.292124 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:15.428030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:15.436466 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:15.437951 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:15.439627 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7d48764d-18a2-4c48-8dce-36a0d7beb6d4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1807 microversion: 2.20 time: 0.160288 Jun 23 10:55:15.440360 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 314/655] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:15 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:16.458441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:16.459078 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:16.465141 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:16.465588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:16.466371 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:16.466811 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:16.469415 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=78 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:16.602595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:16.610865 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:16.612333 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:16.613505 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f58abccf-46fb-47be-832b-443a9173a559 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1794 microversion: 2.20 time: 0.159372 Jun 23 10:55:16.614047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 342/656] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:55:16 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:22.287669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c65fe980-34b1-4800-b667-0550752bb0cb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:22.288837 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c65fe980-34b1-4800-b667-0550752bb0cb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:22.296677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c65fe980-34b1-4800-b667-0550752bb0cb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:22.297395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c65fe980-34b1-4800-b667-0550752bb0cb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:22.298305 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c65fe980-34b1-4800-b667-0550752bb0cb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:22.299445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c65fe980-34b1-4800-b667-0550752bb0cb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:22.374050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c65fe980-34b1-4800-b667-0550752bb0cb tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "POST /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/action" status: 202 len: 0 microversion: 2.1 time: 0.091767 Jun 23 10:55:22.375056 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 315/657] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:55:22 2022] POST /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:55:22.384326 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7dd6a48e-e8de-4e2e-a1a7-6a72ef4cdd6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:22.384901 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7dd6a48e-e8de-4e2e-a1a7-6a72ef4cdd6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:22.388034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=28 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:22.393368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7dd6a48e-e8de-4e2e-a1a7-6a72ef4cdd6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:22.393959 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7dd6a48e-e8de-4e2e-a1a7-6a72ef4cdd6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:22.394789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7dd6a48e-e8de-4e2e-a1a7-6a72ef4cdd6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:22.395194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7dd6a48e-e8de-4e2e-a1a7-6a72ef4cdd6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:22.540235 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7dd6a48e-e8de-4e2e-a1a7-6a72ef4cdd6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:22.548193 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7dd6a48e-e8de-4e2e-a1a7-6a72ef4cdd6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1751 microversion: 2.1 time: 0.167746 Jun 23 10:55:22.549307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 343/658] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:22 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:55:23.566560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-22d0054f-eed4-4dfb-8a3c-d74ec6fca20a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:23.567256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-22d0054f-eed4-4dfb-8a3c-d74ec6fca20a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:23.573930 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-22d0054f-eed4-4dfb-8a3c-d74ec6fca20a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:23.574411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-22d0054f-eed4-4dfb-8a3c-d74ec6fca20a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:23.575430 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-22d0054f-eed4-4dfb-8a3c-d74ec6fca20a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:23.575858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-22d0054f-eed4-4dfb-8a3c-d74ec6fca20a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:23.720987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-22d0054f-eed4-4dfb-8a3c-d74ec6fca20a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:23.728823 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-22d0054f-eed4-4dfb-8a3c-d74ec6fca20a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.167233 Jun 23 10:55:23.729370 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 316/659] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:23 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:24.746382 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b6e67b7b-eb61-4b8b-a4bc-5124775230e8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:24.747079 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b6e67b7b-eb61-4b8b-a4bc-5124775230e8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:24.753249 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b6e67b7b-eb61-4b8b-a4bc-5124775230e8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:24.753692 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b6e67b7b-eb61-4b8b-a4bc-5124775230e8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:24.754500 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b6e67b7b-eb61-4b8b-a4bc-5124775230e8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:24.754939 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b6e67b7b-eb61-4b8b-a4bc-5124775230e8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:24.892045 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b6e67b7b-eb61-4b8b-a4bc-5124775230e8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:24.900556 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b6e67b7b-eb61-4b8b-a4bc-5124775230e8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.158094 Jun 23 10:55:24.901115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 344/660] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:24 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:25.918203 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fb2b923e-f458-4879-a708-0e3d9dcd2e92 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:25.918833 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fb2b923e-f458-4879-a708-0e3d9dcd2e92 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:25.926323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fb2b923e-f458-4879-a708-0e3d9dcd2e92 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:25.926775 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fb2b923e-f458-4879-a708-0e3d9dcd2e92 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:25.927527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fb2b923e-f458-4879-a708-0e3d9dcd2e92 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:25.927958 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fb2b923e-f458-4879-a708-0e3d9dcd2e92 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:25.930630 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:26.070061 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-fb2b923e-f458-4879-a708-0e3d9dcd2e92 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:26.078177 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fb2b923e-f458-4879-a708-0e3d9dcd2e92 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.163861 Jun 23 10:55:26.078756 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 317/661] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:25 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:26.841100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-edbb83b8-1516-4944-bd19-c48ee62020a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e06aea6a-c720-4a0b-9f67-7afe5462ee23"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:26.842199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-edbb83b8-1516-4944-bd19-c48ee62020a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:26.848957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-edbb83b8-1516-4944-bd19-c48ee62020a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:26.849395 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-edbb83b8-1516-4944-bd19-c48ee62020a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:26.850146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-edbb83b8-1516-4944-bd19-c48ee62020a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:26.850608 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-edbb83b8-1516-4944-bd19-c48ee62020a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:27.095231 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b686b33e-0c76-453a-a265-a1efb46a974c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:27.096600 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b686b33e-0c76-453a-a265-a1efb46a974c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:27.103217 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-edbb83b8-1516-4944-bd19-c48ee62020a0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367752 Jun 23 10:55:27.103813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 345/662] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 10:55:26 2022] POST /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:27.104196 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b686b33e-0c76-453a-a265-a1efb46a974c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:27.104646 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b686b33e-0c76-453a-a265-a1efb46a974c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:27.105411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b686b33e-0c76-453a-a265-a1efb46a974c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:27.105843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b686b33e-0c76-453a-a265-a1efb46a974c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:27.256909 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b686b33e-0c76-453a-a265-a1efb46a974c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:27.265898 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b686b33e-0c76-453a-a265-a1efb46a974c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.174827 Jun 23 10:55:27.266488 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 318/663] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:27 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:55:28.286783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-883fa015-f1cb-4042-a0bd-40025a980cd6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:28.287469 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-883fa015-f1cb-4042-a0bd-40025a980cd6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:28.293747 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-883fa015-f1cb-4042-a0bd-40025a980cd6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:28.294187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-883fa015-f1cb-4042-a0bd-40025a980cd6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:28.294972 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-883fa015-f1cb-4042-a0bd-40025a980cd6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:28.295400 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-883fa015-f1cb-4042-a0bd-40025a980cd6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:28.438597 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-883fa015-f1cb-4042-a0bd-40025a980cd6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:28.452603 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-883fa015-f1cb-4042-a0bd-40025a980cd6 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.170952 Jun 23 10:55:28.453166 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 346/664] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:28 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:29.470972 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9990f5ca-85d5-4c53-9d3a-1c744ec3516d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:29.472139 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9990f5ca-85d5-4c53-9d3a-1c744ec3516d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:29.474394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=26 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:29.479711 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9990f5ca-85d5-4c53-9d3a-1c744ec3516d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:29.480097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9990f5ca-85d5-4c53-9d3a-1c744ec3516d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:29.480847 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9990f5ca-85d5-4c53-9d3a-1c744ec3516d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:29.481301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9990f5ca-85d5-4c53-9d3a-1c744ec3516d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:29.625251 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9990f5ca-85d5-4c53-9d3a-1c744ec3516d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:29.633829 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9990f5ca-85d5-4c53-9d3a-1c744ec3516d tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.166830 Jun 23 10:55:29.634425 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 319/665] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:29 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:30.651772 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f147e49f-0b15-42a8-9586-a16a66974e66 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:30.652369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f147e49f-0b15-42a8-9586-a16a66974e66 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:30.659646 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f147e49f-0b15-42a8-9586-a16a66974e66 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:30.660085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f147e49f-0b15-42a8-9586-a16a66974e66 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:30.660831 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f147e49f-0b15-42a8-9586-a16a66974e66 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:30.661260 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f147e49f-0b15-42a8-9586-a16a66974e66 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:30.801472 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f147e49f-0b15-42a8-9586-a16a66974e66 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:30.809272 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f147e49f-0b15-42a8-9586-a16a66974e66 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.161335 Jun 23 10:55:30.809821 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 347/666] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:30 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:31.826321 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a38d5164-4217-481d-9f28-2196bf3175c9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:31.826939 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a38d5164-4217-481d-9f28-2196bf3175c9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:31.834264 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a38d5164-4217-481d-9f28-2196bf3175c9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:31.834732 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a38d5164-4217-481d-9f28-2196bf3175c9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:31.835483 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a38d5164-4217-481d-9f28-2196bf3175c9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:31.835909 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a38d5164-4217-481d-9f28-2196bf3175c9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:31.976539 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a38d5164-4217-481d-9f28-2196bf3175c9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:31.984324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a38d5164-4217-481d-9f28-2196bf3175c9 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.162133 Jun 23 10:55:31.984866 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 320/667] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:31 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:33.001080 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-42cf1a4a-b140-4544-9207-09aa9ec9977a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:33.001680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-42cf1a4a-b140-4544-9207-09aa9ec9977a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:33.008371 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-42cf1a4a-b140-4544-9207-09aa9ec9977a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:33.008807 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-42cf1a4a-b140-4544-9207-09aa9ec9977a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:33.009548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-42cf1a4a-b140-4544-9207-09aa9ec9977a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:33.009972 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-42cf1a4a-b140-4544-9207-09aa9ec9977a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:33.163005 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-42cf1a4a-b140-4544-9207-09aa9ec9977a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:33.170760 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-42cf1a4a-b140-4544-9207-09aa9ec9977a tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.173444 Jun 23 10:55:33.171306 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 348/668] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:32 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:34.188519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-91726a51-85a6-410a-93b3-eb98c5df5b2f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:34.189130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-91726a51-85a6-410a-93b3-eb98c5df5b2f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:34.196121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-91726a51-85a6-410a-93b3-eb98c5df5b2f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:34.196563 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-91726a51-85a6-410a-93b3-eb98c5df5b2f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:34.197319 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-91726a51-85a6-410a-93b3-eb98c5df5b2f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:34.197749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-91726a51-85a6-410a-93b3-eb98c5df5b2f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:34.341538 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-91726a51-85a6-410a-93b3-eb98c5df5b2f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:34.350127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-91726a51-85a6-410a-93b3-eb98c5df5b2f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1756 microversion: 2.1 time: 0.165494 Jun 23 10:55:34.350745 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 321/669] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:34 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:35.367525 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a8ff14eb-2f81-43d5-a0f7-8fdac556daf4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:35.368141 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a8ff14eb-2f81-43d5-a0f7-8fdac556daf4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:35.374617 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a8ff14eb-2f81-43d5-a0f7-8fdac556daf4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:35.375062 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a8ff14eb-2f81-43d5-a0f7-8fdac556daf4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:35.375821 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a8ff14eb-2f81-43d5-a0f7-8fdac556daf4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:35.376257 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a8ff14eb-2f81-43d5-a0f7-8fdac556daf4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:35.516659 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a8ff14eb-2f81-43d5-a0f7-8fdac556daf4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:35.525849 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a8ff14eb-2f81-43d5-a0f7-8fdac556daf4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1759 microversion: 2.1 time: 0.162172 Jun 23 10:55:35.526424 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 349/670] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:35 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:35.656124 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ed89a191-591a-4508-9684-def70a1d3768 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:35.657087 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ed89a191-591a-4508-9684-def70a1d3768 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:35.664571 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ed89a191-591a-4508-9684-def70a1d3768 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:35.665011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ed89a191-591a-4508-9684-def70a1d3768 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:35.665760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ed89a191-591a-4508-9684-def70a1d3768 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:35.666186 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ed89a191-591a-4508-9684-def70a1d3768 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:35.689087 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-ed89a191-591a-4508-9684-def70a1d3768 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lazy-loading 'flavor' on Instance uuid b0b5388c-79f6-4797-a1b9-98518ed970ee {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:55:35.809337 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ed89a191-591a-4508-9684-def70a1d3768 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/action" status: 200 len: 32 microversion: 2.1 time: 0.157152 Jun 23 10:55:35.809982 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 322/671] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:55:35 2022] POST /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 10:55:35.819008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0f653fba-e568-4fa6-b822-222d06b6163c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:35.819609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0f653fba-e568-4fa6-b822-222d06b6163c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:35.826098 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f653fba-e568-4fa6-b822-222d06b6163c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:35.826471 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f653fba-e568-4fa6-b822-222d06b6163c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:35.827489 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f653fba-e568-4fa6-b822-222d06b6163c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:35.827922 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0f653fba-e568-4fa6-b822-222d06b6163c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:35.957163 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0f653fba-e568-4fa6-b822-222d06b6163c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:35.965881 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0f653fba-e568-4fa6-b822-222d06b6163c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.150753 Jun 23 10:55:35.966483 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 350/672] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:35 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:36.984960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e62fae79-f676-4b1e-bb98-55e492ad85e0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:36.985667 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e62fae79-f676-4b1e-bb98-55e492ad85e0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:36.992150 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e62fae79-f676-4b1e-bb98-55e492ad85e0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:36.992585 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e62fae79-f676-4b1e-bb98-55e492ad85e0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:36.993329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e62fae79-f676-4b1e-bb98-55e492ad85e0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:36.993753 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e62fae79-f676-4b1e-bb98-55e492ad85e0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:37.123697 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e62fae79-f676-4b1e-bb98-55e492ad85e0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:37.132271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e62fae79-f676-4b1e-bb98-55e492ad85e0 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.151982 Jun 23 10:55:37.132821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 323/673] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:36 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:38.149840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a5ec025b-5824-48d7-b49e-43e89830812f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:38.150469 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a5ec025b-5824-48d7-b49e-43e89830812f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:38.156981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5ec025b-5824-48d7-b49e-43e89830812f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:38.157421 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5ec025b-5824-48d7-b49e-43e89830812f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:38.158172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5ec025b-5824-48d7-b49e-43e89830812f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:38.159219 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5ec025b-5824-48d7-b49e-43e89830812f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:38.285660 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a5ec025b-5824-48d7-b49e-43e89830812f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:38.293521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a5ec025b-5824-48d7-b49e-43e89830812f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.147464 Jun 23 10:55:38.294020 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 351/674] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:38 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:39.310698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a9106381-b9bf-4256-8cf1-6333eef475a9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:39.311296 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a9106381-b9bf-4256-8cf1-6333eef475a9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:39.317743 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9106381-b9bf-4256-8cf1-6333eef475a9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:39.318179 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9106381-b9bf-4256-8cf1-6333eef475a9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:39.318978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9106381-b9bf-4256-8cf1-6333eef475a9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:39.319385 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a9106381-b9bf-4256-8cf1-6333eef475a9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:39.451938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a9106381-b9bf-4256-8cf1-6333eef475a9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:39.460225 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a9106381-b9bf-4256-8cf1-6333eef475a9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.153356 Jun 23 10:55:39.460779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 324/675] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:39 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:40.477508 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2bf284c3-e01b-4d43-b976-3651bcd28380 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:40.478105 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2bf284c3-e01b-4d43-b976-3651bcd28380 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:40.484690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bf284c3-e01b-4d43-b976-3651bcd28380 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:40.485136 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bf284c3-e01b-4d43-b976-3651bcd28380 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:40.485895 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bf284c3-e01b-4d43-b976-3651bcd28380 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:40.486348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bf284c3-e01b-4d43-b976-3651bcd28380 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:40.615409 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2bf284c3-e01b-4d43-b976-3651bcd28380 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:40.623311 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2bf284c3-e01b-4d43-b976-3651bcd28380 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.149626 Jun 23 10:55:40.623867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 352/676] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:40 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:41.640055 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9eb21922-9b5c-4b1e-8c3d-9f58e2b73986 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:41.640654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9eb21922-9b5c-4b1e-8c3d-9f58e2b73986 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:41.647904 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9eb21922-9b5c-4b1e-8c3d-9f58e2b73986 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:41.648284 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9eb21922-9b5c-4b1e-8c3d-9f58e2b73986 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:41.649035 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9eb21922-9b5c-4b1e-8c3d-9f58e2b73986 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:41.649546 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9eb21922-9b5c-4b1e-8c3d-9f58e2b73986 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:41.778885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9eb21922-9b5c-4b1e-8c3d-9f58e2b73986 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:41.786803 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9eb21922-9b5c-4b1e-8c3d-9f58e2b73986 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.150765 Jun 23 10:55:41.787368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 325/677] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:41 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:42.804028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-956e23ac-aa39-4d8f-80b9-ad9c89eca75b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:42.804636 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-956e23ac-aa39-4d8f-80b9-ad9c89eca75b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:42.811031 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-956e23ac-aa39-4d8f-80b9-ad9c89eca75b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:42.811475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-956e23ac-aa39-4d8f-80b9-ad9c89eca75b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:42.812230 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-956e23ac-aa39-4d8f-80b9-ad9c89eca75b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:42.812662 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-956e23ac-aa39-4d8f-80b9-ad9c89eca75b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:42.938533 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-956e23ac-aa39-4d8f-80b9-ad9c89eca75b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:42.946985 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-956e23ac-aa39-4d8f-80b9-ad9c89eca75b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.147000 Jun 23 10:55:42.947650 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 353/678] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:42 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:43.964881 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5c18b107-c145-4daa-8864-03c9a7b17421 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:43.965501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5c18b107-c145-4daa-8864-03c9a7b17421 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:43.972657 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5c18b107-c145-4daa-8864-03c9a7b17421 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:43.973093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5c18b107-c145-4daa-8864-03c9a7b17421 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:43.973834 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5c18b107-c145-4daa-8864-03c9a7b17421 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:43.974259 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5c18b107-c145-4daa-8864-03c9a7b17421 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:44.103437 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5c18b107-c145-4daa-8864-03c9a7b17421 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:44.112597 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5c18b107-c145-4daa-8864-03c9a7b17421 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.150805 Jun 23 10:55:44.113169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 326/679] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:43 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:45.129874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-40a29bb8-c546-4ef3-9db5-88cfe74e213b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:45.130502 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-40a29bb8-c546-4ef3-9db5-88cfe74e213b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:45.137277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-40a29bb8-c546-4ef3-9db5-88cfe74e213b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:45.137722 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-40a29bb8-c546-4ef3-9db5-88cfe74e213b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:45.138545 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-40a29bb8-c546-4ef3-9db5-88cfe74e213b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:45.138978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-40a29bb8-c546-4ef3-9db5-88cfe74e213b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:45.271277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-40a29bb8-c546-4ef3-9db5-88cfe74e213b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:45.279097 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-40a29bb8-c546-4ef3-9db5-88cfe74e213b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.153396 Jun 23 10:55:45.279654 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 354/680] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:45 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:46.296417 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-14700e1a-62df-44eb-a898-e80ac055610e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:46.297020 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-14700e1a-62df-44eb-a898-e80ac055610e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:46.304168 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14700e1a-62df-44eb-a898-e80ac055610e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:46.304605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14700e1a-62df-44eb-a898-e80ac055610e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:46.305347 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14700e1a-62df-44eb-a898-e80ac055610e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:46.305773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14700e1a-62df-44eb-a898-e80ac055610e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:46.434030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-14700e1a-62df-44eb-a898-e80ac055610e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:46.442117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-14700e1a-62df-44eb-a898-e80ac055610e tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.149627 Jun 23 10:55:46.442678 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 327/681] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:46 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:47.459399 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9a4b78f4-316f-4e93-8947-68be29c2700c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:47.460000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9a4b78f4-316f-4e93-8947-68be29c2700c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:47.466480 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9a4b78f4-316f-4e93-8947-68be29c2700c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:47.466918 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9a4b78f4-316f-4e93-8947-68be29c2700c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:47.467662 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9a4b78f4-316f-4e93-8947-68be29c2700c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:47.468083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9a4b78f4-316f-4e93-8947-68be29c2700c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:47.472183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:47.608008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9a4b78f4-316f-4e93-8947-68be29c2700c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:47.616989 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9a4b78f4-316f-4e93-8947-68be29c2700c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.161384 Jun 23 10:55:47.617563 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 355/682] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:47 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:48.632921 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-56059ddf-7d72-4ee6-bbeb-2e299e1f42c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:48.633526 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-56059ddf-7d72-4ee6-bbeb-2e299e1f42c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:48.639882 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56059ddf-7d72-4ee6-bbeb-2e299e1f42c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:48.640327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56059ddf-7d72-4ee6-bbeb-2e299e1f42c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:48.641074 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56059ddf-7d72-4ee6-bbeb-2e299e1f42c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:48.641501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-56059ddf-7d72-4ee6-bbeb-2e299e1f42c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:48.774056 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-56059ddf-7d72-4ee6-bbeb-2e299e1f42c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:48.781909 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-56059ddf-7d72-4ee6-bbeb-2e299e1f42c6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.152843 Jun 23 10:55:48.782484 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 328/683] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:48 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:49.799603 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3602e504-8012-48a4-b296-ba5dc73d9d95 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:49.801780 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3602e504-8012-48a4-b296-ba5dc73d9d95 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:49.808019 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3602e504-8012-48a4-b296-ba5dc73d9d95 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:49.808464 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3602e504-8012-48a4-b296-ba5dc73d9d95 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:49.809230 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3602e504-8012-48a4-b296-ba5dc73d9d95 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:49.809663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3602e504-8012-48a4-b296-ba5dc73d9d95 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:49.936554 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-3602e504-8012-48a4-b296-ba5dc73d9d95 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:49.944785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3602e504-8012-48a4-b296-ba5dc73d9d95 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.149722 Jun 23 10:55:49.945356 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 356/684] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:49 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:50.962604 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ce664640-2d4e-4096-b39f-8720c0f98514 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:50.963214 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ce664640-2d4e-4096-b39f-8720c0f98514 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:50.969394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ce664640-2d4e-4096-b39f-8720c0f98514 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:50.969841 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ce664640-2d4e-4096-b39f-8720c0f98514 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:50.970620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ce664640-2d4e-4096-b39f-8720c0f98514 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:50.971351 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ce664640-2d4e-4096-b39f-8720c0f98514 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:51.338961 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ce664640-2d4e-4096-b39f-8720c0f98514 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:51.347929 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ce664640-2d4e-4096-b39f-8720c0f98514 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.389196 Jun 23 10:55:51.348485 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 329/685] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:50 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:52.365018 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2de0e54b-2f0c-48dc-b18d-8f592fe2386d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:52.365622 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2de0e54b-2f0c-48dc-b18d-8f592fe2386d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:52.372076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2de0e54b-2f0c-48dc-b18d-8f592fe2386d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:52.372521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2de0e54b-2f0c-48dc-b18d-8f592fe2386d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:52.373272 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2de0e54b-2f0c-48dc-b18d-8f592fe2386d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:52.373711 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2de0e54b-2f0c-48dc-b18d-8f592fe2386d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:52.500614 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2de0e54b-2f0c-48dc-b18d-8f592fe2386d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:52.509135 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2de0e54b-2f0c-48dc-b18d-8f592fe2386d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.148466 Jun 23 10:55:52.509685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 357/686] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:52 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:53.526547 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1a822f92-d145-444c-a593-ea3cc36bbdb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:53.527169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1a822f92-d145-444c-a593-ea3cc36bbdb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:53.534144 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a822f92-d145-444c-a593-ea3cc36bbdb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:53.534662 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a822f92-d145-444c-a593-ea3cc36bbdb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:53.535359 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a822f92-d145-444c-a593-ea3cc36bbdb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:53.535814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1a822f92-d145-444c-a593-ea3cc36bbdb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:53.665479 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1a822f92-d145-444c-a593-ea3cc36bbdb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:53.673300 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1a822f92-d145-444c-a593-ea3cc36bbdb6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.150650 Jun 23 10:55:53.673886 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 330/687] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:53 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:54.691550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-22370edd-dfcd-4183-95aa-7e9a7adb1f4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:54.692077 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-22370edd-dfcd-4183-95aa-7e9a7adb1f4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:54.694360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=30 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:54.699718 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22370edd-dfcd-4183-95aa-7e9a7adb1f4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:54.700168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22370edd-dfcd-4183-95aa-7e9a7adb1f4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:54.701183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22370edd-dfcd-4183-95aa-7e9a7adb1f4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:54.701617 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-22370edd-dfcd-4183-95aa-7e9a7adb1f4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:54.827963 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-22370edd-dfcd-4183-95aa-7e9a7adb1f4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:54.836002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-22370edd-dfcd-4183-95aa-7e9a7adb1f4f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1735 microversion: 2.1 time: 0.148906 Jun 23 10:55:54.836561 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 358/688] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:54 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:55.854485 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-492a8c28-0932-477a-9e6d-cf6bdf6ccef2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:55.855095 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-492a8c28-0932-477a-9e6d-cf6bdf6ccef2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:55.861728 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-492a8c28-0932-477a-9e6d-cf6bdf6ccef2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:55.862176 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-492a8c28-0932-477a-9e6d-cf6bdf6ccef2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:55.863002 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-492a8c28-0932-477a-9e6d-cf6bdf6ccef2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:55.863433 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-492a8c28-0932-477a-9e6d-cf6bdf6ccef2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:55.996696 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-492a8c28-0932-477a-9e6d-cf6bdf6ccef2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:55.999022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:56.007002 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-492a8c28-0932-477a-9e6d-cf6bdf6ccef2 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1715 microversion: 2.1 time: 0.156353 Jun 23 10:55:56.007712 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 331/689] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:55 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:56.061134 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:56.061674 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:56.068948 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:56.069395 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:56.070156 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:56.070635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:56.193587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] HTTP exception thrown: Cannot 'detach_volume' instance b0b5388c-79f6-4797-a1b9-98518ed970ee while it is in vm_state rescued Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Request method failure captured: Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: DELETE /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments/e06aea6a-c720-4a0b-9f67-7afe5462ee23 HTTP/1.1 Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgvRgPZd-B_64ft6SWQKWYQrdfYdRK3rH49v70jABcjg2aJorfdpCiePsKlYrulilBUvCm1hQU-ZZR_2zNn-lsf0oJgctRN6MpIzT7LQnot0J45gZ6Q13Fx1smgynpjCQiB_5V-vYmSFkjDF9UFZDCIuhAjfLfpTkGw4uI5ZAbF2E Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:55:56.195552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eacce04e67d14a2f8ae63f5cd115b69c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: d230950f9e984a8b878d7d0f74dda3ce Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:55:56.197190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Cannot 'detach_volume' instance b0b5388c-79f6-4797-a1b9-98518ed970ee while it is in vm_state rescued Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'server_id': 'b0b5388c-79f6-4797-a1b9-98518ed970ee', 'id': 'e06aea6a-c720-4a0b-9f67-7afe5462ee23'} Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0b5388c-79f6-4797-a1b9-98518ed970ee in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:55:56.197975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b0b5388c-79f6-4797-a1b9-98518ed970ee while it is in vm_state rescued Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b0b5388c-79f6-4797-a1b9-98518ed970ee while it is in vm_state rescued Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:55:56.199281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Returning 409 to user: Cannot 'detach_volume' instance b0b5388c-79f6-4797-a1b9-98518ed970ee while it is in vm_state rescued {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:55:56.200540 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-93f08f12-963d-46eb-9a30-85ccf8807d6c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments/e06aea6a-c720-4a0b-9f67-7afe5462ee23" status: 409 len: 152 microversion: 2.1 time: 0.139718 Jun 23 10:55:56.200540 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 359/690] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 10:55:56 2022] DELETE /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments/e06aea6a-c720-4a0b-9f67-7afe5462ee23 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 10:55:56.206558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7691a7cb-8d17-4e1d-96a9-6e972fd03683 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:56.207085 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7691a7cb-8d17-4e1d-96a9-6e972fd03683 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:56.213378 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7691a7cb-8d17-4e1d-96a9-6e972fd03683 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:56.213821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7691a7cb-8d17-4e1d-96a9-6e972fd03683 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:56.214596 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7691a7cb-8d17-4e1d-96a9-6e972fd03683 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:56.215023 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7691a7cb-8d17-4e1d-96a9-6e972fd03683 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:56.280811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7691a7cb-8d17-4e1d-96a9-6e972fd03683 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "POST /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/action" status: 202 len: 0 microversion: 2.1 time: 0.078324 Jun 23 10:55:56.283834 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 332/691] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:55:56 2022] POST /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:55:56.289514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2ce309f2-5e3c-46c8-9a6c-d509906c37ea tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:56.290865 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2ce309f2-5e3c-46c8-9a6c-d509906c37ea tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:56.296975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2ce309f2-5e3c-46c8-9a6c-d509906c37ea tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:56.297444 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2ce309f2-5e3c-46c8-9a6c-d509906c37ea tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:56.298256 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2ce309f2-5e3c-46c8-9a6c-d509906c37ea tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:56.298738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2ce309f2-5e3c-46c8-9a6c-d509906c37ea tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:56.431254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2ce309f2-5e3c-46c8-9a6c-d509906c37ea tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:56.439280 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2ce309f2-5e3c-46c8-9a6c-d509906c37ea tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1723 microversion: 2.1 time: 0.153589 Jun 23 10:55:56.439835 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 360/692] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:56 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:57.458775 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a2fe23c0-923c-478b-ba7d-ff359ab4b45f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:57.459464 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a2fe23c0-923c-478b-ba7d-ff359ab4b45f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:57.465688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2fe23c0-923c-478b-ba7d-ff359ab4b45f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:57.466125 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2fe23c0-923c-478b-ba7d-ff359ab4b45f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:57.466896 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2fe23c0-923c-478b-ba7d-ff359ab4b45f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:57.467325 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2fe23c0-923c-478b-ba7d-ff359ab4b45f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:57.601426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a2fe23c0-923c-478b-ba7d-ff359ab4b45f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:57.610241 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a2fe23c0-923c-478b-ba7d-ff359ab4b45f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1723 microversion: 2.1 time: 0.156510 Jun 23 10:55:57.611913 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 333/693] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:57 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:58.629635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2bf46ccc-f644-420e-87e5-683ab4ba3f41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:58.630235 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2bf46ccc-f644-420e-87e5-683ab4ba3f41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:58.636299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bf46ccc-f644-420e-87e5-683ab4ba3f41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:58.636736 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bf46ccc-f644-420e-87e5-683ab4ba3f41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:58.637479 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bf46ccc-f644-420e-87e5-683ab4ba3f41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:58.637904 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bf46ccc-f644-420e-87e5-683ab4ba3f41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:58.766859 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2bf46ccc-f644-420e-87e5-683ab4ba3f41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:58.776008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2bf46ccc-f644-420e-87e5-683ab4ba3f41 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1723 microversion: 2.1 time: 0.150359 Jun 23 10:55:58.776567 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 361/694] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:58 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:59.793480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b5f41ffb-6215-4223-89c7-c9e28d396967 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:59.794013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b5f41ffb-6215-4223-89c7-c9e28d396967 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:55:59.796472 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=30 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:59.802634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5f41ffb-6215-4223-89c7-c9e28d396967 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:59.803070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5f41ffb-6215-4223-89c7-c9e28d396967 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:59.803816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5f41ffb-6215-4223-89c7-c9e28d396967 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:55:59.804240 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5f41ffb-6215-4223-89c7-c9e28d396967 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:55:59.936708 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b5f41ffb-6215-4223-89c7-c9e28d396967 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:55:59.944608 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b5f41ffb-6215-4223-89c7-c9e28d396967 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1723 microversion: 2.1 time: 0.155022 Jun 23 10:55:59.945184 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 334/695] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:55:59 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:00.962821 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7094c4ea-ada5-4ea7-9495-6519df3a4d81 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:00.963433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7094c4ea-ada5-4ea7-9495-6519df3a4d81 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:00.969921 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7094c4ea-ada5-4ea7-9495-6519df3a4d81 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:00.970390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7094c4ea-ada5-4ea7-9495-6519df3a4d81 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:00.971153 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7094c4ea-ada5-4ea7-9495-6519df3a4d81 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:00.972321 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7094c4ea-ada5-4ea7-9495-6519df3a4d81 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:01.101028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7094c4ea-ada5-4ea7-9495-6519df3a4d81 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:01.108853 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7094c4ea-ada5-4ea7-9495-6519df3a4d81 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1729 microversion: 2.1 time: 0.149919 Jun 23 10:56:01.109406 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 362/696] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:00 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:01.124881 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a806e59d-000e-48a6-b901-6c840b4d19fc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:01.125411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a806e59d-000e-48a6-b901-6c840b4d19fc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:01.132815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a806e59d-000e-48a6-b901-6c840b4d19fc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:01.133260 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a806e59d-000e-48a6-b901-6c840b4d19fc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:01.134013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a806e59d-000e-48a6-b901-6c840b4d19fc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:01.134484 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a806e59d-000e-48a6-b901-6c840b4d19fc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:01.210263 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a806e59d-000e-48a6-b901-6c840b4d19fc tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089117 Jun 23 10:56:01.210896 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 335/697] 10.222.0.39 () {58 vars in 1274 bytes} [Thu Jun 23 10:56:01 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:02.137258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-22e2101b-c67a-41f3-af6e-81327d11790b req-34135a79-d20d-4819-a406-563b4ac003bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b5388c-79f6-4797-a1b9-98518ed970ee", "tag": "dd66f398-76e8-408c-bd60-d35c977b57e5"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:02.146767 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-22e2101b-c67a-41f3-af6e-81327d11790b req-34135a79-d20d-4819-a406-563b4ac003bc service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:02.147385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-22e2101b-c67a-41f3-af6e-81327d11790b req-34135a79-d20d-4819-a406-563b4ac003bc service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:02.159982 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-22e2101b-c67a-41f3-af6e-81327d11790b req-34135a79-d20d-4819-a406-563b4ac003bc service nova] Creating event network-changed:dd66f398-76e8-408c-bd60-d35c977b57e5 for instance b0b5388c-79f6-4797-a1b9-98518ed970ee on hv-cinder-84614 Jun 23 10:56:02.165491 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-22e2101b-c67a-41f3-af6e-81327d11790b req-34135a79-d20d-4819-a406-563b4ac003bc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088712 Jun 23 10:56:02.166144 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 363/698] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:04.180036 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-83e70e71-eb43-4ee3-9659-3c7ceaffc441 req-57751077-526c-46f5-8485-1cf8f6514690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b5388c-79f6-4797-a1b9-98518ed970ee", "tag": "dd66f398-76e8-408c-bd60-d35c977b57e5"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:04.188081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-83e70e71-eb43-4ee3-9659-3c7ceaffc441 req-57751077-526c-46f5-8485-1cf8f6514690 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:04.188519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-83e70e71-eb43-4ee3-9659-3c7ceaffc441 req-57751077-526c-46f5-8485-1cf8f6514690 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:04.200069 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-83e70e71-eb43-4ee3-9659-3c7ceaffc441 req-57751077-526c-46f5-8485-1cf8f6514690 service nova] Creating event network-changed:dd66f398-76e8-408c-bd60-d35c977b57e5 for instance b0b5388c-79f6-4797-a1b9-98518ed970ee on hv-cinder-84614 Jun 23 10:56:04.205290 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-83e70e71-eb43-4ee3-9659-3c7ceaffc441 req-57751077-526c-46f5-8485-1cf8f6514690 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029660 Jun 23 10:56:04.206575 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 336/699] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:04.856829 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9c534767-125b-43d7-8ce7-874be691dd78 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:04.857437 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9c534767-125b-43d7-8ce7-874be691dd78 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:04.864181 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9c534767-125b-43d7-8ce7-874be691dd78 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:04.864629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9c534767-125b-43d7-8ce7-874be691dd78 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:04.865395 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9c534767-125b-43d7-8ce7-874be691dd78 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:04.865925 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9c534767-125b-43d7-8ce7-874be691dd78 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:04.888748 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9c534767-125b-43d7-8ce7-874be691dd78 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593/ips" status: 200 len: 150 microversion: 2.1 time: 0.134856 Jun 23 10:56:04.889279 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 364/700] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 10:56:04 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593/ips => generated 150 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:04.902405 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dae14c38-7a7e-4aa6-80c7-63bb502758d1"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:04.903547 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:04.910507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:04.910959 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:04.911726 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:04.912157 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:04.990541 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Invalid volume: volume dae14c38-7a7e-4aa6-80c7-63bb502758d1 is already attached to instances: b14d1ef1-2756-4058-a3e8-52c83a121833 Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: POST /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593/os-volume_attachments HTTP/1.1 Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 74 Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:56:04.992246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {"volumeAttachment": {"volumeId": "dae14c38-7a7e-4aa6-80c7-63bb502758d1"}} Jun 23 10:56:04.993781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Invalid volume: volume dae14c38-7a7e-4aa6-80c7-63bb502758d1 is already attached to instances: b14d1ef1-2756-4058-a3e8-52c83a121833 Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'server_id': '2112b96a-009d-4c3d-90ac-aaa4acd04593', 'body': {'volumeAttachment': {'volumeId': 'dae14c38-7a7e-4aa6-80c7-63bb502758d1'}}} Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dae14c38-7a7e-4aa6-80c7-63bb502758d1 is already attached to instances: b14d1ef1-2756-4058-a3e8-52c83a121833 Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:04.994870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dae14c38-7a7e-4aa6-80c7-63bb502758d1 is already attached to instances: b14d1ef1-2756-4058-a3e8-52c83a121833 Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:04.996313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:04.997883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:04.997883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:56:04.997883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:56:04.997883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dae14c38-7a7e-4aa6-80c7-63bb502758d1 is already attached to instances: b14d1ef1-2756-4058-a3e8-52c83a121833 Jun 23 10:56:04.997883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:04.997883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 400 to user: Invalid volume: volume dae14c38-7a7e-4aa6-80c7-63bb502758d1 is already attached to instances: b14d1ef1-2756-4058-a3e8-52c83a121833 {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:56:04.997883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d5bc9d52-8d5f-4bb4-bcfe-c4a9bde93330 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095760 Jun 23 10:56:04.997883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 337/701] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 10:56:04 2022] POST /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 10:56:05.002582 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fa2bd1d9-2115-464d-91e5-b5c1e773acec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:05.003520 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fa2bd1d9-2115-464d-91e5-b5c1e773acec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:05.009379 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1d9-2115-464d-91e5-b5c1e773acec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:05.009823 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1d9-2115-464d-91e5-b5c1e773acec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:05.010606 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1d9-2115-464d-91e5-b5c1e773acec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:05.011044 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1d9-2115-464d-91e5-b5c1e773acec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:05.036332 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fa2bd1d9-2115-464d-91e5-b5c1e773acec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:56:05.113312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fa2bd1d9-2115-464d-91e5-b5c1e773acec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 204 len: 0 microversion: 2.1 time: 0.113042 Jun 23 10:56:05.113893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 365/702] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:56:04 2022] DELETE /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:56:05.124115 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c8cc19a8-e633-4721-a94e-3be15f28a5e9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:05.125258 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c8cc19a8-e633-4721-a94e-3be15f28a5e9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:05.133865 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c8cc19a8-e633-4721-a94e-3be15f28a5e9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:05.134340 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c8cc19a8-e633-4721-a94e-3be15f28a5e9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:05.135108 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c8cc19a8-e633-4721-a94e-3be15f28a5e9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:05.135546 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c8cc19a8-e633-4721-a94e-3be15f28a5e9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:05.266717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c8cc19a8-e633-4721-a94e-3be15f28a5e9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:05.274956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c8cc19a8-e633-4721-a94e-3be15f28a5e9 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1682 microversion: 2.1 time: 0.155852 Jun 23 10:56:05.275503 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 338/703] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:05 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:06.293440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bc9bab34-855a-4be0-93d0-b7300d7efb34 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:06.294140 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bc9bab34-855a-4be0-93d0-b7300d7efb34 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:06.301275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc9bab34-855a-4be0-93d0-b7300d7efb34 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:06.301723 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc9bab34-855a-4be0-93d0-b7300d7efb34 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:06.302520 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc9bab34-855a-4be0-93d0-b7300d7efb34 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:06.302957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc9bab34-855a-4be0-93d0-b7300d7efb34 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:06.434253 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bc9bab34-855a-4be0-93d0-b7300d7efb34 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:06.442493 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bc9bab34-855a-4be0-93d0-b7300d7efb34 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1682 microversion: 2.1 time: 0.153184 Jun 23 10:56:06.443063 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 366/704] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:06 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:07.460823 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6058a84f-9205-4267-b44e-06c225dd93ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:07.461436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6058a84f-9205-4267-b44e-06c225dd93ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:07.468310 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6058a84f-9205-4267-b44e-06c225dd93ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:07.468749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6058a84f-9205-4267-b44e-06c225dd93ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:07.469512 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6058a84f-9205-4267-b44e-06c225dd93ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:07.469944 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6058a84f-9205-4267-b44e-06c225dd93ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:07.604114 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6058a84f-9205-4267-b44e-06c225dd93ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:07.611529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6058a84f-9205-4267-b44e-06c225dd93ea tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1682 microversion: 2.1 time: 0.155478 Jun 23 10:56:07.612480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 339/705] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:07 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:08.340659 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-c769d6a8-37d7-4033-8f6e-ccca207a8a73 req-b2a5bc8a-be27-461e-8fe7-9196aae08e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2112b96a-009d-4c3d-90ac-aaa4acd04593", "name": "network-vif-deleted", "tag": "9a379fae-31ed-47bf-8eb6-88ddcd9023c7"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:08.349711 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-c769d6a8-37d7-4033-8f6e-ccca207a8a73 req-b2a5bc8a-be27-461e-8fe7-9196aae08e4b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:08.350233 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-c769d6a8-37d7-4033-8f6e-ccca207a8a73 req-b2a5bc8a-be27-461e-8fe7-9196aae08e4b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:08.362183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-c769d6a8-37d7-4033-8f6e-ccca207a8a73 req-b2a5bc8a-be27-461e-8fe7-9196aae08e4b service nova] Creating event network-vif-deleted:9a379fae-31ed-47bf-8eb6-88ddcd9023c7 for instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 on hv-cinder-84614 Jun 23 10:56:08.369098 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-c769d6a8-37d7-4033-8f6e-ccca207a8a73 req-b2a5bc8a-be27-461e-8fe7-9196aae08e4b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089695 Jun 23 10:56:08.369879 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 367/706] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:08.631315 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:08.631953 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:08.639130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:08.639617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:08.640384 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:08.640815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:08.675095 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:08.678666 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:08.681775 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lazy-loading 'fault' on Instance uuid 2112b96a-009d-4c3d-90ac-aaa4acd04593 {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:56:08.735452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:08.744334 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ea1796f0-41ef-4b67-8721-01a3e5804093 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 200 len: 1331 microversion: 2.1 time: 0.119286 Jun 23 10:56:08.745565 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 340/707] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:08 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:09.762655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:09.763370 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:09.771047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:09.771496 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:09.772271 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:09.772706 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:09.786049 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 HTTP/1.1 Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:56:09.787705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 10:56:09.789312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '2112b96a-009d-4c3d-90ac-aaa4acd04593'} Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:56:09.790187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 10:56:09.791683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:09.793035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:56:09.793035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5ee858de-2f6b-4526-9e5e-00c64fc96fb4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 404 len: 111 microversion: 2.1 time: 0.030677 Jun 23 10:56:09.793035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 368/708] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:09 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:56:09.798345 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-524acc2f-6714-4f2a-84a2-4d0c9c1719a1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '.version_select at 0x7f8dc92f0ee0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:09.820022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-524acc2f-6714-4f2a-84a2-4d0c9c1719a1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270310407" status: 202 len: 0 microversion: 2.1 time: 0.025523 Jun 23 10:56:09.820569 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 341/709] 10.222.0.39 () {58 vars in 1220 bytes} [Thu Jun 23 10:56:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270310407 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:56:10.500587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5b5c1f99-aa06-4de8-9187-59587ffc3bed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:10.501077 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5b5c1f99-aa06-4de8-9187-59587ffc3bed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:10.507829 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5b5c1f99-aa06-4de8-9187-59587ffc3bed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:10.508293 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5b5c1f99-aa06-4de8-9187-59587ffc3bed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:10.509030 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5b5c1f99-aa06-4de8-9187-59587ffc3bed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:10.509463 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5b5c1f99-aa06-4de8-9187-59587ffc3bed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:10.592663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-5b5c1f99-aa06-4de8-9187-59587ffc3bed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lazy-loading 'services' on Instance uuid b14d1ef1-2756-4058-a3e8-52c83a121833 {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:56:10.703018 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5b5c1f99-aa06-4de8-9187-59587ffc3bed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-volume_attachments/dae14c38-7a7e-4aa6-80c7-63bb502758d1" status: 202 len: 0 microversion: 2.1 time: 0.206110 Jun 23 10:56:10.703664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 369/710] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 10:56:10 2022] DELETE /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-volume_attachments/dae14c38-7a7e-4aa6-80c7-63bb502758d1 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:56:10.712029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-82b697f8-392f-4ba6-9e28-84c4fb0b7f91 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:10.712944 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-82b697f8-392f-4ba6-9e28-84c4fb0b7f91 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:10.719299 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82b697f8-392f-4ba6-9e28-84c4fb0b7f91 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:10.719682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82b697f8-392f-4ba6-9e28-84c4fb0b7f91 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:10.720501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82b697f8-392f-4ba6-9e28-84c4fb0b7f91 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:10.721058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-82b697f8-392f-4ba6-9e28-84c4fb0b7f91 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:10.756667 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-82b697f8-392f-4ba6-9e28-84c4fb0b7f91 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048537 Jun 23 10:56:10.757214 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 342/711] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:56:10 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:11.769847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-822f392a-f36e-4742-b571-38e7fcd37ab7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:11.770916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-822f392a-f36e-4742-b571-38e7fcd37ab7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:11.777147 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-822f392a-f36e-4742-b571-38e7fcd37ab7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:11.777590 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-822f392a-f36e-4742-b571-38e7fcd37ab7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:11.778363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-822f392a-f36e-4742-b571-38e7fcd37ab7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:11.778798 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-822f392a-f36e-4742-b571-38e7fcd37ab7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:11.808547 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-822f392a-f36e-4742-b571-38e7fcd37ab7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043950 Jun 23 10:56:11.809089 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 370/712] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:56:11 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 10:56:11.866682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8d970a05-8346-478a-9209-0580fd5479a8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:11.867273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8d970a05-8346-478a-9209-0580fd5479a8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:11.873573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d970a05-8346-478a-9209-0580fd5479a8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:11.874015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d970a05-8346-478a-9209-0580fd5479a8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:11.874813 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d970a05-8346-478a-9209-0580fd5479a8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:11.875242 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d970a05-8346-478a-9209-0580fd5479a8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:11.900495 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8d970a05-8346-478a-9209-0580fd5479a8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Going to try to terminate instance {{(pid=129461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:56:11.975263 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8d970a05-8346-478a-9209-0580fd5479a8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 204 len: 0 microversion: 2.1 time: 0.112807 Jun 23 10:56:11.975999 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 343/713] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:56:11 2022] DELETE /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:56:11.985839 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b0ff216c-75d2-4513-a232-6c142df40526 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:11.986705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b0ff216c-75d2-4513-a232-6c142df40526 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:11.992705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b0ff216c-75d2-4513-a232-6c142df40526 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:11.993142 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b0ff216c-75d2-4513-a232-6c142df40526 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:11.993888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b0ff216c-75d2-4513-a232-6c142df40526 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:11.994327 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b0ff216c-75d2-4513-a232-6c142df40526 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:12.122299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b0ff216c-75d2-4513-a232-6c142df40526 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:12.124616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:12.131628 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b0ff216c-75d2-4513-a232-6c142df40526 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1681 microversion: 2.1 time: 0.151284 Jun 23 10:56:12.132187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 371/714] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:11 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:13.149518 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4e5da520-62df-49e0-b3d0-54dfd22872e1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:13.150110 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4e5da520-62df-49e0-b3d0-54dfd22872e1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:13.156629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4e5da520-62df-49e0-b3d0-54dfd22872e1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:13.157068 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4e5da520-62df-49e0-b3d0-54dfd22872e1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:13.158012 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4e5da520-62df-49e0-b3d0-54dfd22872e1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:13.158476 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4e5da520-62df-49e0-b3d0-54dfd22872e1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:13.292936 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4e5da520-62df-49e0-b3d0-54dfd22872e1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:13.301233 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4e5da520-62df-49e0-b3d0-54dfd22872e1 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1681 microversion: 2.1 time: 0.155962 Jun 23 10:56:13.301777 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 344/715] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:13 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:14.318719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b23a800f-6804-450e-a4ab-23fc5bd1dcbc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:14.319324 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b23a800f-6804-450e-a4ab-23fc5bd1dcbc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:14.326897 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b23a800f-6804-450e-a4ab-23fc5bd1dcbc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:14.327345 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b23a800f-6804-450e-a4ab-23fc5bd1dcbc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:14.328115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b23a800f-6804-450e-a4ab-23fc5bd1dcbc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:14.328545 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b23a800f-6804-450e-a4ab-23fc5bd1dcbc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:14.396111 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b23a800f-6804-450e-a4ab-23fc5bd1dcbc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:14.403817 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b23a800f-6804-450e-a4ab-23fc5bd1dcbc tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 200 len: 1613 microversion: 2.1 time: 0.089542 Jun 23 10:56:14.404486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 372/716] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:14 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:14.644373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-527f909c-daaa-4596-a609-832966c7c6bd req-0ddd8763-65fa-41d1-b055-80a8d85c0286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14d1ef1-2756-4058-a3e8-52c83a121833", "name": "network-vif-deleted", "tag": "9c57cf5e-0cd4-4e3a-9734-57918143c3e0"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:14.653736 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-527f909c-daaa-4596-a609-832966c7c6bd req-0ddd8763-65fa-41d1-b055-80a8d85c0286 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:14.654198 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-527f909c-daaa-4596-a609-832966c7c6bd req-0ddd8763-65fa-41d1-b055-80a8d85c0286 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:14.665616 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-527f909c-daaa-4596-a609-832966c7c6bd req-0ddd8763-65fa-41d1-b055-80a8d85c0286 service nova] Creating event network-vif-deleted:9c57cf5e-0cd4-4e3a-9734-57918143c3e0 for instance b14d1ef1-2756-4058-a3e8-52c83a121833 on hv-cinder-84614 Jun 23 10:56:14.670878 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-527f909c-daaa-4596-a609-832966c7c6bd req-0ddd8763-65fa-41d1-b055-80a8d85c0286 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030939 Jun 23 10:56:14.671512 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 345/717] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:56:15.422041 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:15.422730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:15.429195 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:15.429640 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:15.430441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:15.430873 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:15.444934 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 HTTP/1.1 Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:56:15.446632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 10:56:15.448146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'b14d1ef1-2756-4058-a3e8-52c83a121833'} Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:56:15.449015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 10:56:15.450877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:15.452280 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:56:15.452280 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5836300e-377a-4bc3-8b32-2e21fa562df3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 404 len: 111 microversion: 2.1 time: 0.029737 Jun 23 10:56:15.452280 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 373/718] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:15 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:56:15.458604 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fccb3248-834d-4b0f-89bf-bfe17cec4a90 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '.version_select at 0x7f8dc9650d30>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:15.475741 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fccb3248-834d-4b0f-89bf-bfe17cec4a90 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439996733" status: 202 len: 0 microversion: 2.1 time: 0.022237 Jun 23 10:56:15.476291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 346/719] 10.222.0.39 () {58 vars in 1220 bytes} [Thu Jun 23 10:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439996733 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:56:16.118655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-57c869f7-b452-47d2-a1cf-1e0237572601 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: .version_select at 0x7f8dc92f8e50>, body: {"keypair": {"name": "tempest-keypair-1197397116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWIEMzJ9T9Kp7MxVLTbfIkEeWPi1B6n3YsjXINljjD1tDpksseoQjjma/SH6PxP6xnsBYvDyBFzI/YZwGFIsktBrty+mwpfW0beM4U2dgk85qq3myqiDCSx5KDV0JPXgg=="}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:16.132749 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-57c869f7-b452-47d2-a1cf-1e0237572601 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for project 2123ff10502044b9aea48720440c2291. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:56:16.136554 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-57c869f7-b452-47d2-a1cf-1e0237572601 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for user eb8df5670686403480cdfd32ac408945 and project 2123ff10502044b9aea48720440c2291. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:56:16.148879 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR oslo.messaging._drivers.impl_rabbit [None req-57c869f7-b452-47d2-a1cf-1e0237572601 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [dd2833a5-cee0-44fa-b12e-8593fbe39c84] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 10:56:17.156670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [None req-57c869f7-b452-47d2-a1cf-1e0237572601 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [dd2833a5-cee0-44fa-b12e-8593fbe39c84] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 48870. Jun 23 10:56:17.171141 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-57c869f7-b452-47d2-a1cf-1e0237572601 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.057502 Jun 23 10:56:17.171718 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 374/720] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 10:56:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:18.613164 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-971111735", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66f9eed7-b9a6-4658-b62c-bb41bfa6807b"}], "security_groups": [{"name": "tempest-securitygroup--1130659105"}], "key_name": "tempest-keypair-1197397116", "user_data": "}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:18.719047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] validate_networks() for [('66f9eed7-b9a6-4658-b62c-bb41bfa6807b', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:56:19.135697 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:56:19.136123 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:56:19.136598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:56:19.137006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:56:19.137413 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:56:19.147038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:19.147577 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:19.148413 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:19.148885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:19.166605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for project 2123ff10502044b9aea48720440c2291. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:56:19.170574 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for user eb8df5670686403480cdfd32ac408945 and project 2123ff10502044b9aea48720440c2291. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:56:19.182597 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:56:19.184935 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:56:19.231756 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f5649dc8-2bc2-4e47-b6f3-84b822f9060f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.624035 Jun 23 10:56:19.232382 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 347/721] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:56:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:56:19.243507 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-21e3727d-be55-4259-9786-6cb1787e0c23 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:19.244090 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-21e3727d-be55-4259-9786-6cb1787e0c23 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:19.298376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-21e3727d-be55-4259-9786-6cb1787e0c23 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:19.305511 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-21e3727d-be55-4259-9786-6cb1787e0c23 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1241 microversion: 2.1 time: 0.066276 Jun 23 10:56:19.306059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 375/722] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:19 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:20.322082 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-93d8fdbb-284e-4e41-adae-bd3be35c2843 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:20.323341 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-93d8fdbb-284e-4e41-adae-bd3be35c2843 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:20.376097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-93d8fdbb-284e-4e41-adae-bd3be35c2843 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:20.383147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-93d8fdbb-284e-4e41-adae-bd3be35c2843 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1241 microversion: 2.1 time: 0.065686 Jun 23 10:56:20.383861 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 348/723] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:20 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:21.400105 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ad00d3fa-250e-48f1-8ad0-0d5779af97ac tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:21.400712 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ad00d3fa-250e-48f1-8ad0-0d5779af97ac tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:21.455183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ad00d3fa-250e-48f1-8ad0-0d5779af97ac tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:21.462828 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ad00d3fa-250e-48f1-8ad0-0d5779af97ac tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1241 microversion: 2.1 time: 0.066419 Jun 23 10:56:21.463392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 376/724] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:21 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:22.479956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-45287e2e-6577-4d61-a671-5dad8928b67f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:22.480557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-45287e2e-6577-4d61-a671-5dad8928b67f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:22.531885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-45287e2e-6577-4d61-a671-5dad8928b67f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:22.539312 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-45287e2e-6577-4d61-a671-5dad8928b67f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1241 microversion: 2.1 time: 0.063203 Jun 23 10:56:22.539875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 349/725] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:22 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:23.556034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-63cab52f-4005-4d54-bd3a-2f908b7fbd4a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:23.556638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-63cab52f-4005-4d54-bd3a-2f908b7fbd4a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:23.564160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-63cab52f-4005-4d54-bd3a-2f908b7fbd4a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:23.564609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-63cab52f-4005-4d54-bd3a-2f908b7fbd4a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:23.565430 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-63cab52f-4005-4d54-bd3a-2f908b7fbd4a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:23.565887 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-63cab52f-4005-4d54-bd3a-2f908b7fbd4a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:23.615677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5a0efcc4-19a8-4aa4-ad97-12d4baa7f235 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:23.616260 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5a0efcc4-19a8-4aa4-ad97-12d4baa7f235 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:23.623501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5a0efcc4-19a8-4aa4-ad97-12d4baa7f235 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:23.624454 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5a0efcc4-19a8-4aa4-ad97-12d4baa7f235 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:23.625847 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5a0efcc4-19a8-4aa4-ad97-12d4baa7f235 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:23.626467 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5a0efcc4-19a8-4aa4-ad97-12d4baa7f235 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:23.627213 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-63cab52f-4005-4d54-bd3a-2f908b7fbd4a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:23.634633 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-63cab52f-4005-4d54-bd3a-2f908b7fbd4a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1245 microversion: 2.1 time: 0.082578 Jun 23 10:56:23.635201 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 377/726] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:23 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:23.657213 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5a0efcc4-19a8-4aa4-ad97-12d4baa7f235 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments/0197af19-8059-493c-a4ab-36d642ac320e" status: 200 len: 194 microversion: 2.20 time: 0.045895 Jun 23 10:56:23.657781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 350/727] 10.222.0.39 () {60 vars in 1453 bytes} [Thu Jun 23 10:56:23 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments/0197af19-8059-493c-a4ab-36d642ac320e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 10:56:23.721212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6bbe28bb-4096-4089-a0b6-c637c2d4f52e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:23.722990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6bbe28bb-4096-4089-a0b6-c637c2d4f52e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:23.730145 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6bbe28bb-4096-4089-a0b6-c637c2d4f52e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:23.730641 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6bbe28bb-4096-4089-a0b6-c637c2d4f52e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:23.731409 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6bbe28bb-4096-4089-a0b6-c637c2d4f52e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:23.732415 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6bbe28bb-4096-4089-a0b6-c637c2d4f52e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:23.818260 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-6bbe28bb-4096-4089-a0b6-c637c2d4f52e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lazy-loading 'services' on Instance uuid 737a2c37-15f8-4f42-a879-af5af910fd30 {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:56:23.898435 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6bbe28bb-4096-4089-a0b6-c637c2d4f52e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "DELETE /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments/0197af19-8059-493c-a4ab-36d642ac320e" status: 202 len: 0 microversion: 2.20 time: 0.181017 Jun 23 10:56:23.899214 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 378/728] 10.222.0.39 () {60 vars in 1456 bytes} [Thu Jun 23 10:56:23 2022] DELETE /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments/0197af19-8059-493c-a4ab-36d642ac320e => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:56:23.907682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2a8cbb35-180f-424f-825e-dbe1040a75d8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:23.908677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2a8cbb35-180f-424f-825e-dbe1040a75d8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:23.915773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2a8cbb35-180f-424f-825e-dbe1040a75d8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:23.916568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2a8cbb35-180f-424f-825e-dbe1040a75d8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:23.917502 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2a8cbb35-180f-424f-825e-dbe1040a75d8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:23.917959 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2a8cbb35-180f-424f-825e-dbe1040a75d8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:23.949345 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:23.956571 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2a8cbb35-180f-424f-825e-dbe1040a75d8 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052668 Jun 23 10:56:23.957244 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 351/729] 10.222.0.39 () {60 vars in 1342 bytes} [Thu Jun 23 10:56:23 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:56:24.654130 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5d703778-91ee-4d18-b7ce-4e9674e31415 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:24.655483 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5d703778-91ee-4d18-b7ce-4e9674e31415 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:24.663279 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5d703778-91ee-4d18-b7ce-4e9674e31415 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:24.663973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5d703778-91ee-4d18-b7ce-4e9674e31415 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:24.665368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5d703778-91ee-4d18-b7ce-4e9674e31415 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:24.665801 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5d703778-91ee-4d18-b7ce-4e9674e31415 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:24.732307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5d703778-91ee-4d18-b7ce-4e9674e31415 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:24.745647 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5d703778-91ee-4d18-b7ce-4e9674e31415 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1301 microversion: 2.1 time: 0.095803 Jun 23 10:56:24.746884 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 379/730] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:24 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:24.971016 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7648a149-b4a6-4856-9778-42ae36d631d5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:24.972808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7648a149-b4a6-4856-9778-42ae36d631d5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:24.980015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7648a149-b4a6-4856-9778-42ae36d631d5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:24.980497 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7648a149-b4a6-4856-9778-42ae36d631d5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:24.981302 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7648a149-b4a6-4856-9778-42ae36d631d5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:24.981840 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7648a149-b4a6-4856-9778-42ae36d631d5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:25.019751 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7648a149-b4a6-4856-9778-42ae36d631d5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054782 Jun 23 10:56:25.020314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 352/731] 10.222.0.39 () {60 vars in 1342 bytes} [Thu Jun 23 10:56:24 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:25.079932 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5ee2660a-e82f-4c3f-8606-c44c07c13aae tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:25.080432 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5ee2660a-e82f-4c3f-8606-c44c07c13aae tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:25.083228 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:25.090370 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5ee2660a-e82f-4c3f-8606-c44c07c13aae tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:25.090810 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5ee2660a-e82f-4c3f-8606-c44c07c13aae tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:25.091571 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5ee2660a-e82f-4c3f-8606-c44c07c13aae tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:25.091996 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5ee2660a-e82f-4c3f-8606-c44c07c13aae tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:25.118738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5ee2660a-e82f-4c3f-8606-c44c07c13aae tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:56:25.201502 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5ee2660a-e82f-4c3f-8606-c44c07c13aae tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "DELETE /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 204 len: 0 microversion: 2.20 time: 0.125070 Jun 23 10:56:25.202089 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 380/732] 10.222.0.39 () {60 vars in 1279 bytes} [Thu Jun 23 10:56:25 2022] DELETE /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 10:56:25.211798 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:25.212582 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:25.222804 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:25.223394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:25.224317 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:25.224818 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:25.362792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:25.371939 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:25.373526 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:25.374817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-520f07e1-eac8-4244-a06e-ad971622d506 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.167781 Jun 23 10:56:25.375462 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 353/733] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:25 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:25.764902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d14f3cfe-ab43-4355-a09f-8f72d6787059 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:25.765587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d14f3cfe-ab43-4355-a09f-8f72d6787059 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:25.772743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d14f3cfe-ab43-4355-a09f-8f72d6787059 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:25.773177 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d14f3cfe-ab43-4355-a09f-8f72d6787059 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:25.773927 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d14f3cfe-ab43-4355-a09f-8f72d6787059 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:25.774384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d14f3cfe-ab43-4355-a09f-8f72d6787059 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:25.900288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d14f3cfe-ab43-4355-a09f-8f72d6787059 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:25.907830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d14f3cfe-ab43-4355-a09f-8f72d6787059 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.147078 Jun 23 10:56:25.908392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 381/734] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:25 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:26.394093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:26.394723 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:26.401102 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:26.401543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:26.402304 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:26.402756 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:26.540717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:26.549005 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:26.550550 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:26.551713 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8ebf57ed-8b63-44ef-8709-b6035e9467b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.161572 Jun 23 10:56:26.552619 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 354/735] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:26 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:26.924284 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bc32debe-8ef1-4fd5-8e6f-f4f52fbf9cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:26.926047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bc32debe-8ef1-4fd5-8e6f-f4f52fbf9cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:26.932944 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc32debe-8ef1-4fd5-8e6f-f4f52fbf9cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:26.933758 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc32debe-8ef1-4fd5-8e6f-f4f52fbf9cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:26.934591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc32debe-8ef1-4fd5-8e6f-f4f52fbf9cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:26.935024 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc32debe-8ef1-4fd5-8e6f-f4f52fbf9cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:27.080033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bc32debe-8ef1-4fd5-8e6f-f4f52fbf9cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:27.087942 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bc32debe-8ef1-4fd5-8e6f-f4f52fbf9cc6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.167429 Jun 23 10:56:27.088548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 382/736] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:26 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:27.186067 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-e197fedc-6dfe-4f91-bb5b-2d507a5293c2 req-4308ac65-0092-46c1-a82f-3fa20a9c6ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988e9d74-e535-4569-9f46-7970232b6723", "tag": "9a8602f0-56bb-47e7-93fe-d02998644df6"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:27.198659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-e197fedc-6dfe-4f91-bb5b-2d507a5293c2 req-4308ac65-0092-46c1-a82f-3fa20a9c6ca7 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:27.199526 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-e197fedc-6dfe-4f91-bb5b-2d507a5293c2 req-4308ac65-0092-46c1-a82f-3fa20a9c6ca7 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:27.212158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-e197fedc-6dfe-4f91-bb5b-2d507a5293c2 req-4308ac65-0092-46c1-a82f-3fa20a9c6ca7 service nova] Creating event network-changed:9a8602f0-56bb-47e7-93fe-d02998644df6 for instance 988e9d74-e535-4569-9f46-7970232b6723 on hv-cinder-84614 Jun 23 10:56:27.217262 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-e197fedc-6dfe-4f91-bb5b-2d507a5293c2 req-4308ac65-0092-46c1-a82f-3fa20a9c6ca7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034970 Jun 23 10:56:27.218230 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 355/737] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:27.569095 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:27.569703 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:27.576282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:27.576734 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:27.577501 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:27.578028 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:27.707889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:27.715988 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:27.717562 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:27.718634 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-28325de9-924e-4747-843e-592a60af1ee0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1722 microversion: 2.20 time: 0.153540 Jun 23 10:56:27.719538 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 383/738] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:27 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:28.105919 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a5fdf121-f84c-4320-95b7-87bc302904b7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:28.106755 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a5fdf121-f84c-4320-95b7-87bc302904b7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:28.112878 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a5fdf121-f84c-4320-95b7-87bc302904b7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:28.113322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a5fdf121-f84c-4320-95b7-87bc302904b7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:28.114078 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a5fdf121-f84c-4320-95b7-87bc302904b7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:28.114535 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a5fdf121-f84c-4320-95b7-87bc302904b7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:28.254683 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a5fdf121-f84c-4320-95b7-87bc302904b7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:28.261995 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a5fdf121-f84c-4320-95b7-87bc302904b7 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.160746 Jun 23 10:56:28.262569 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 356/739] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:28 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:28.737771 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:28.739013 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:28.746286 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:28.746994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:28.748449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:28.748449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:28.827811 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:28.839559 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:28.841172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:28.842892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-06bde61a-941f-4328-b3da-287eacd458ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1654 microversion: 2.20 time: 0.110148 Jun 23 10:56:28.843558 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 384/740] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:28 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1654 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:56:29.237672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-882fb407-048e-42fb-a24b-65874cc64280 req-227404de-bb4b-4331-b1a6-f1266002014f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737a2c37-15f8-4f42-a879-af5af910fd30", "name": "network-vif-deleted", "tag": "025ad83b-3dde-441a-ae8a-ae243337df1c"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:29.241707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:29.248101 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-882fb407-048e-42fb-a24b-65874cc64280 req-227404de-bb4b-4331-b1a6-f1266002014f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:29.248543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-882fb407-048e-42fb-a24b-65874cc64280 req-227404de-bb4b-4331-b1a6-f1266002014f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:29.260794 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-882fb407-048e-42fb-a24b-65874cc64280 req-227404de-bb4b-4331-b1a6-f1266002014f service nova] Creating event network-vif-deleted:025ad83b-3dde-441a-ae8a-ae243337df1c for instance 737a2c37-15f8-4f42-a879-af5af910fd30 on hv-cinder-84614 Jun 23 10:56:29.265960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-882fb407-048e-42fb-a24b-65874cc64280 req-227404de-bb4b-4331-b1a6-f1266002014f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032472 Jun 23 10:56:29.266602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 357/741] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:29.279943 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-16004c1b-2e53-4387-a2b9-b0a9239f44b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:29.280642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-16004c1b-2e53-4387-a2b9-b0a9239f44b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:29.287481 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-16004c1b-2e53-4387-a2b9-b0a9239f44b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:29.287949 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-16004c1b-2e53-4387-a2b9-b0a9239f44b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:29.288709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-16004c1b-2e53-4387-a2b9-b0a9239f44b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:29.289135 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-16004c1b-2e53-4387-a2b9-b0a9239f44b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:29.417071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-16004c1b-2e53-4387-a2b9-b0a9239f44b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:29.425075 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-16004c1b-2e53-4387-a2b9-b0a9239f44b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.148902 Jun 23 10:56:29.425933 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 385/742] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:29 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:29.863336 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:29.864016 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:29.865905 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:29.871557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:29.871996 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:29.872747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:29.873172 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:29.939464 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:29.947414 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:29.948887 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:29.950015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3d7d675c-5dc8-498b-97e6-daad06be24a7 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 200 len: 1654 microversion: 2.20 time: 0.091511 Jun 23 10:56:29.950843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 358/743] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:29 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 1654 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:30.442196 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d51bd443-7c1b-4b2c-a826-48b18d87c5ab tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:30.442830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d51bd443-7c1b-4b2c-a826-48b18d87c5ab tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:30.449318 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d51bd443-7c1b-4b2c-a826-48b18d87c5ab tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:30.449761 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d51bd443-7c1b-4b2c-a826-48b18d87c5ab tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:30.450805 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d51bd443-7c1b-4b2c-a826-48b18d87c5ab tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:30.451247 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d51bd443-7c1b-4b2c-a826-48b18d87c5ab tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:30.581056 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d51bd443-7c1b-4b2c-a826-48b18d87c5ab tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:30.589552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d51bd443-7c1b-4b2c-a826-48b18d87c5ab tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.151712 Jun 23 10:56:30.600205 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 386/744] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:30 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:30.968597 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:30.969205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:30.976295 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:30.976738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:30.977489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:30.977920 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:30.992250 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] HTTP exception thrown: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Request method failure captured: Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 HTTP/1.1 Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVe-43zMedEC24gk9dDiHodLgofVqJ-VL8OuBhwyG8fI0Jd0H7TbrS9OWBanIjwu6h4bphPgWKlYUvdCytIKooRxNfUMLExgaA3pzX7u8KJ9CsfwlCnOOSDTSKw4uh5pp5iLfCf8g1Dh4Wy2_Uv5TC9GGVvemQmWacbZ-rVM6fltq0 Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:56:30.993923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11861d35a3444734be8870f47cce1b9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: b0b95c321c4a452faa81a93168c7bf0a Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 10:56:30.995588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '737a2c37-15f8-4f42-a879-af5af910fd30'} Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:56:30.996557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 10:56:30.998193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:30.999514 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Returning 404 to user: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:56:30.999514 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-993fa0cb-fd58-4121-ba16-ddb33fb39397 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 404 len: 111 microversion: 2.20 time: 0.031100 Jun 23 10:56:30.999514 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 359/745] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:30 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 10:56:31.005889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4c5955ed-9477-4636-b34a-25483f55de4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '.version_select at 0x7f8dc91a3430>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:31.024548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4c5955ed-9477-4636-b34a-25483f55de4b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-496390611" status: 204 len: 0 microversion: 2.20 time: 0.023037 Jun 23 10:56:31.025115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 387/746] 10.222.0.39 () {60 vars in 1258 bytes} [Thu Jun 23 10:56:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-496390611 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 10:56:31.607942 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-521cc85d-e96e-4b51-b270-53fa40d15623 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:31.608570 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-521cc85d-e96e-4b51-b270-53fa40d15623 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:31.614891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-521cc85d-e96e-4b51-b270-53fa40d15623 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:31.615291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-521cc85d-e96e-4b51-b270-53fa40d15623 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:31.616056 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-521cc85d-e96e-4b51-b270-53fa40d15623 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:31.616481 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-521cc85d-e96e-4b51-b270-53fa40d15623 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:31.648299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=8 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:31.652731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5d7ebdb5-4958-4d35-9d0c-a55b155871d6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'create', calling method: .version_select at 0x7f8dc91fc0d0>, body: {"keypair": {"name": "tempest-keypair-786109015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdWzFACXzl1yTWx4nc5KIprelB5vsClUpRMExnYVx4AklSLk9KxcpJCriu3wyHHDrRTzINQGuKb2YhaeHVKLguR9y5qe7/AXF2vBbYXg7/4FmPdI27u/xDBF7ttio1CYg=="}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:31.667748 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-5d7ebdb5-4958-4d35-9d0c-a55b155871d6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Getting quotas for project 11861d35a3444734be8870f47cce1b9b. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:56:31.671576 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-5d7ebdb5-4958-4d35-9d0c-a55b155871d6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Getting quotas for user b0b95c321c4a452faa81a93168c7bf0a and project 11861d35a3444734be8870f47cce1b9b. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:56:31.694504 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5d7ebdb5-4958-4d35-9d0c-a55b155871d6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047452 Jun 23 10:56:31.695089 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 388/747] 10.222.0.39 () {62 vars in 1199 bytes} [Thu Jun 23 10:56:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 23 10:56:31.751986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-521cc85d-e96e-4b51-b270-53fa40d15623 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:31.760523 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-521cc85d-e96e-4b51-b270-53fa40d15623 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.156712 Jun 23 10:56:31.761079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 360/748] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:31 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:32.777685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0104c960-12b0-4fff-ac59-2231dd871ed8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:32.778334 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0104c960-12b0-4fff-ac59-2231dd871ed8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:32.784987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0104c960-12b0-4fff-ac59-2231dd871ed8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:32.785433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0104c960-12b0-4fff-ac59-2231dd871ed8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:32.786200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0104c960-12b0-4fff-ac59-2231dd871ed8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:32.786661 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0104c960-12b0-4fff-ac59-2231dd871ed8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:32.911396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1445418623", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a2d2fa8-1b72-4e3b-a7e9-7705374b5eb3"}], "security_groups": [{"name": "tempest-securitygroup--2021960950"}], "key_name": "tempest-keypair-786109015", "user_data": "}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:32.918310 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=10 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:32.924993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0104c960-12b0-4fff-ac59-2231dd871ed8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:32.933132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0104c960-12b0-4fff-ac59-2231dd871ed8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.159750 Jun 23 10:56:32.933761 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 389/749] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:32 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:33.015785 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] validate_networks() for [('5a2d2fa8-1b72-4e3b-a7e9-7705374b5eb3', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:56:33.384184 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:56:33.384615 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:56:33.385119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:56:33.385544 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:56:33.385954 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:56:33.395435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:33.395883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:33.396674 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:33.397107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:33.414558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Getting quotas for project 11861d35a3444734be8870f47cce1b9b. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:56:33.418493 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Getting quotas for user b0b95c321c4a452faa81a93168c7bf0a and project 11861d35a3444734be8870f47cce1b9b. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:56:33.429510 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:56:33.431785 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:56:33.478519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f14d05c9-db4f-47ac-9bed-499e098277e6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.571969 Jun 23 10:56:33.479156 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 361/750] 10.222.0.39 () {62 vars in 1187 bytes} [Thu Jun 23 10:56:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 23 10:56:33.493348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-dbc888fb-77b9-4c8b-9f2c-0739d784b7b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:33.494554 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-dbc888fb-77b9-4c8b-9f2c-0739d784b7b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:33.551982 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dbc888fb-77b9-4c8b-9f2c-0739d784b7b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:33.559453 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dbc888fb-77b9-4c8b-9f2c-0739d784b7b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:33.560954 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dbc888fb-77b9-4c8b-9f2c-0739d784b7b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:33.562054 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-dbc888fb-77b9-4c8b-9f2c-0739d784b7b0 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1281 microversion: 2.20 time: 0.076231 Jun 23 10:56:33.562836 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 390/751] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:33 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:33.951602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6e84e5c7-55aa-45d2-9407-fc51e775fbec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:33.952211 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6e84e5c7-55aa-45d2-9407-fc51e775fbec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:33.959013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6e84e5c7-55aa-45d2-9407-fc51e775fbec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:33.959736 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6e84e5c7-55aa-45d2-9407-fc51e775fbec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:33.960443 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6e84e5c7-55aa-45d2-9407-fc51e775fbec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:33.960877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6e84e5c7-55aa-45d2-9407-fc51e775fbec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:34.099111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6e84e5c7-55aa-45d2-9407-fc51e775fbec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:34.106793 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6e84e5c7-55aa-45d2-9407-fc51e775fbec tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.160164 Jun 23 10:56:34.107377 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 362/752] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:33 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:34.581326 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:34.582068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:34.589316 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:34.589769 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:34.590564 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:34.590994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:34.657726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:34.666456 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:34.668195 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:34.669477 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c728743a-3461-4dbe-be63-4ca41c6fb424 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1351 microversion: 2.20 time: 0.093000 Jun 23 10:56:34.675036 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 391/753] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:34 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:35.124334 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8fcafe00-769d-44c8-934a-cdded36c6ff8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:35.125056 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8fcafe00-769d-44c8-934a-cdded36c6ff8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:35.133845 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8fcafe00-769d-44c8-934a-cdded36c6ff8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:35.134481 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8fcafe00-769d-44c8-934a-cdded36c6ff8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:35.135453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8fcafe00-769d-44c8-934a-cdded36c6ff8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:35.135951 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8fcafe00-769d-44c8-934a-cdded36c6ff8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:35.214045 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-c2439de7-a160-4968-97ed-26070113ad9d req-330d7b63-430e-4c66-a912-4512cb188fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988e9d74-e535-4569-9f46-7970232b6723", "name": "network-vif-plugged", "status": "completed", "tag": "9a8602f0-56bb-47e7-93fe-d02998644df6"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:35.224421 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-c2439de7-a160-4968-97ed-26070113ad9d req-330d7b63-430e-4c66-a912-4512cb188fcc service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:35.224802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-c2439de7-a160-4968-97ed-26070113ad9d req-330d7b63-430e-4c66-a912-4512cb188fcc service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:35.239521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-c2439de7-a160-4968-97ed-26070113ad9d req-330d7b63-430e-4c66-a912-4512cb188fcc service nova] Creating event network-vif-plugged:9a8602f0-56bb-47e7-93fe-d02998644df6 for instance 988e9d74-e535-4569-9f46-7970232b6723 on hv-cinder-84614 Jun 23 10:56:35.244774 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-c2439de7-a160-4968-97ed-26070113ad9d req-330d7b63-430e-4c66-a912-4512cb188fcc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105009 Jun 23 10:56:35.245319 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 392/754] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:56:35.304456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8fcafe00-769d-44c8-934a-cdded36c6ff8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:35.312420 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8fcafe00-769d-44c8-934a-cdded36c6ff8 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.191973 Jun 23 10:56:35.312977 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 363/755] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:35 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:35.689282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:35.690730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:35.697542 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:35.698196 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:35.699089 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:35.699587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:35.716157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:35.839102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:35.847199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:35.848689 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:35.849794 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-19fc871e-7155-4120-8f79-5c123277e54f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.165365 Jun 23 10:56:35.850373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 393/756] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:35 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:56:36.329497 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b9253710-2a6a-436b-8712-8f02ecaf8677 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:36.330235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b9253710-2a6a-436b-8712-8f02ecaf8677 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:36.337755 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9253710-2a6a-436b-8712-8f02ecaf8677 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:36.338208 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9253710-2a6a-436b-8712-8f02ecaf8677 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:36.339011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9253710-2a6a-436b-8712-8f02ecaf8677 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:36.339443 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9253710-2a6a-436b-8712-8f02ecaf8677 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:36.456974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-387149ec-e1b6-4217-9ef9-e95ce8f8fc60 req-37d995ed-c194-4121-b034-b7553f03d2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf2c8ff-3746-44d7-9eeb-96dc1c860432", "tag": "42635af4-43f0-435c-bf3e-bc1aabbcf87a"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:36.470473 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-387149ec-e1b6-4217-9ef9-e95ce8f8fc60 req-37d995ed-c194-4121-b034-b7553f03d2e1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:36.470765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-387149ec-e1b6-4217-9ef9-e95ce8f8fc60 req-37d995ed-c194-4121-b034-b7553f03d2e1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:36.491897 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-387149ec-e1b6-4217-9ef9-e95ce8f8fc60 req-37d995ed-c194-4121-b034-b7553f03d2e1 service nova] Creating event network-changed:42635af4-43f0-435c-bf3e-bc1aabbcf87a for instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 on hv-cinder-84614 Jun 23 10:56:36.497613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-387149ec-e1b6-4217-9ef9-e95ce8f8fc60 req-37d995ed-c194-4121-b034-b7553f03d2e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045366 Jun 23 10:56:36.498210 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 394/757] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:56:36.500028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b9253710-2a6a-436b-8712-8f02ecaf8677 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:36.508295 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b9253710-2a6a-436b-8712-8f02ecaf8677 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1367 microversion: 2.1 time: 0.182985 Jun 23 10:56:36.508862 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 364/758] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:36 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:36.869241 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:36.869930 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:36.876127 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:36.876585 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:36.877332 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:36.878306 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:36.959881 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0d8153e6-f4bc-42c7-9f57-62b4bfbda9d4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-253261177"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:36.960322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-0d8153e6-f4bc-42c7-9f57-62b4bfbda9d4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:36.966361 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0d8153e6-f4bc-42c7-9f57-62b4bfbda9d4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:36.966806 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0d8153e6-f4bc-42c7-9f57-62b4bfbda9d4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:36.967564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0d8153e6-f4bc-42c7-9f57-62b4bfbda9d4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:36.967993 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0d8153e6-f4bc-42c7-9f57-62b4bfbda9d4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:37.021315 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:37.029161 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:37.031577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:37.033004 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d888a064-cda4-420e-a358-cae865c93e1b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.168689 Jun 23 10:56:37.034994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 395/759] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:36 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:37.109345 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.network.security_group_api [None req-0d8153e6-f4bc-42c7-9f57-62b4bfbda9d4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Removing security group 52db7a48-207a-4b90-85f5-0572da88d360 from port e3febbb8-c828-460d-9a89-e3851649705f Jun 23 10:56:37.452700 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0d8153e6-f4bc-42c7-9f57-62b4bfbda9d4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "POST /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/action" status: 202 len: 0 microversion: 2.1 time: 0.497984 Jun 23 10:56:37.453307 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 365/760] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:56:36 2022] POST /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 10:56:37.466891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-7e4f9ae7-faf7-4b20-92cc-f3dcf8177664 req-36fb5d74-96b8-4b8c-9ebe-2f3c41151d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7546151-13d3-41c1-b4df-a064682f764a", "tag": "e3febbb8-c828-460d-9a89-e3851649705f"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:37.479880 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-7e4f9ae7-faf7-4b20-92cc-f3dcf8177664 req-36fb5d74-96b8-4b8c-9ebe-2f3c41151d8d service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:37.480468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-7e4f9ae7-faf7-4b20-92cc-f3dcf8177664 req-36fb5d74-96b8-4b8c-9ebe-2f3c41151d8d service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:37.500150 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-7e4f9ae7-faf7-4b20-92cc-f3dcf8177664 req-36fb5d74-96b8-4b8c-9ebe-2f3c41151d8d service nova] Creating event network-changed:e3febbb8-c828-460d-9a89-e3851649705f for instance a7546151-13d3-41c1-b4df-a064682f764a on hv-cinder-84614 Jun 23 10:56:37.507494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-7e4f9ae7-faf7-4b20-92cc-f3dcf8177664 req-36fb5d74-96b8-4b8c-9ebe-2f3c41151d8d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046457 Jun 23 10:56:37.507770 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 396/761] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:37.532266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-19bdb8f1-250f-401e-b0b0-7ae42afd7c44 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:37.534262 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-19bdb8f1-250f-401e-b0b0-7ae42afd7c44 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:37.547840 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-19bdb8f1-250f-401e-b0b0-7ae42afd7c44 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:37.548533 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-19bdb8f1-250f-401e-b0b0-7ae42afd7c44 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:37.549945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-19bdb8f1-250f-401e-b0b0-7ae42afd7c44 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:37.550591 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-19bdb8f1-250f-401e-b0b0-7ae42afd7c44 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:37.813322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-19bdb8f1-250f-401e-b0b0-7ae42afd7c44 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:37.825309 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-19bdb8f1-250f-401e-b0b0-7ae42afd7c44 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1557 microversion: 2.1 time: 0.301062 Jun 23 10:56:37.826997 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 366/762] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:37 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1557 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:37.843578 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-395100ff-8b0e-4dd4-821b-72dc6ed6dd36 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:37.844155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-395100ff-8b0e-4dd4-821b-72dc6ed6dd36 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:37.850643 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-395100ff-8b0e-4dd4-821b-72dc6ed6dd36 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:37.851089 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-395100ff-8b0e-4dd4-821b-72dc6ed6dd36 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:37.851867 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-395100ff-8b0e-4dd4-821b-72dc6ed6dd36 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:37.852299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-395100ff-8b0e-4dd4-821b-72dc6ed6dd36 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:37.937121 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-395100ff-8b0e-4dd4-821b-72dc6ed6dd36 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097768 Jun 23 10:56:37.944288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 397/763] 10.222.0.39 () {58 vars in 1274 bytes} [Thu Jun 23 10:56:37 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:38.053535 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:38.054427 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:38.062208 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:38.062958 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:38.064500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:38.065723 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:38.480356 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:38.489456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:38.490975 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:38.492732 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-66a42977-9ef5-40db-9acf-8e8cd97c4732 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.444546 Jun 23 10:56:38.499235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 367/764] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:38 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:39.185172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bf53e9b7-ae73-4869-908a-7982e67a7f6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:39.191107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-bde92491-a2f1-4c12-bcf4-d3ea57b3ef9e req-bf1b7dec-c0d1-4d4a-b447-8982967e6623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7546151-13d3-41c1-b4df-a064682f764a", "tag": "e3febbb8-c828-460d-9a89-e3851649705f"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:39.195683 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bf53e9b7-ae73-4869-908a-7982e67a7f6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:39.204789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf53e9b7-ae73-4869-908a-7982e67a7f6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:39.205536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf53e9b7-ae73-4869-908a-7982e67a7f6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:39.207059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf53e9b7-ae73-4869-908a-7982e67a7f6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:39.207519 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf53e9b7-ae73-4869-908a-7982e67a7f6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:39.208838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-bde92491-a2f1-4c12-bcf4-d3ea57b3ef9e req-bf1b7dec-c0d1-4d4a-b447-8982967e6623 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:39.212730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-bde92491-a2f1-4c12-bcf4-d3ea57b3ef9e req-bf1b7dec-c0d1-4d4a-b447-8982967e6623 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:39.226064 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-bde92491-a2f1-4c12-bcf4-d3ea57b3ef9e req-bf1b7dec-c0d1-4d4a-b447-8982967e6623 service nova] Creating event network-changed:e3febbb8-c828-460d-9a89-e3851649705f for instance a7546151-13d3-41c1-b4df-a064682f764a on hv-cinder-84614 Jun 23 10:56:39.232946 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-bde92491-a2f1-4c12-bcf4-d3ea57b3ef9e req-bf1b7dec-c0d1-4d4a-b447-8982967e6623 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045642 Jun 23 10:56:39.239264 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 368/765] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:39.303345 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-bf53e9b7-ae73-4869-908a-7982e67a7f6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lazy-loading 'services' on Instance uuid a7546151-13d3-41c1-b4df-a064682f764a {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:56:39.384857 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bf53e9b7-ae73-4869-908a-7982e67a7f6c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments/30a99c7a-697c-41e6-aad7-3a02f5e46881" status: 202 len: 0 microversion: 2.1 time: 0.203922 Jun 23 10:56:39.386102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 398/766] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 10:56:39 2022] DELETE /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments/30a99c7a-697c-41e6-aad7-3a02f5e46881 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:56:39.396147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-47667762-78b6-474b-956d-09b6896f2293 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:39.397261 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-47667762-78b6-474b-956d-09b6896f2293 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:39.404489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-47667762-78b6-474b-956d-09b6896f2293 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:39.405028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-47667762-78b6-474b-956d-09b6896f2293 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:39.405884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-47667762-78b6-474b-956d-09b6896f2293 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:39.406429 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-47667762-78b6-474b-956d-09b6896f2293 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:39.437431 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-47667762-78b6-474b-956d-09b6896f2293 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046863 Jun 23 10:56:39.438411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 369/767] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:56:39 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:39.511720 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:39.512410 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:39.520660 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:39.521845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:39.522844 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:39.523438 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:39.526656 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-d93ac6b2-cf70-4b48-a7d4-809b51a0fadc req-4ea9360b-ebb9-405a-97d8-76143bac895f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988e9d74-e535-4569-9f46-7970232b6723", "tag": "9a8602f0-56bb-47e7-93fe-d02998644df6"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:39.537843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-d93ac6b2-cf70-4b48-a7d4-809b51a0fadc req-4ea9360b-ebb9-405a-97d8-76143bac895f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:39.538391 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-d93ac6b2-cf70-4b48-a7d4-809b51a0fadc req-4ea9360b-ebb9-405a-97d8-76143bac895f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:39.553872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-d93ac6b2-cf70-4b48-a7d4-809b51a0fadc req-4ea9360b-ebb9-405a-97d8-76143bac895f service nova] Creating event network-changed:9a8602f0-56bb-47e7-93fe-d02998644df6 for instance 988e9d74-e535-4569-9f46-7970232b6723 on hv-cinder-84614 Jun 23 10:56:39.559592 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-d93ac6b2-cf70-4b48-a7d4-809b51a0fadc req-4ea9360b-ebb9-405a-97d8-76143bac895f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036663 Jun 23 10:56:39.560560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 370/768] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:39.666078 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:39.675326 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:39.677209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:39.678334 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ebf9dcfe-cce8-4dc4-96d9-6d507761a8b1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.171046 Jun 23 10:56:39.685057 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 399/769] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:39 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:40.454443 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-67ecf686-3ea5-4d74-b005-ef8cdfe0a01f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:40.455594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-67ecf686-3ea5-4d74-b005-ef8cdfe0a01f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:40.464286 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-67ecf686-3ea5-4d74-b005-ef8cdfe0a01f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:40.465037 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-67ecf686-3ea5-4d74-b005-ef8cdfe0a01f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:40.466259 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-67ecf686-3ea5-4d74-b005-ef8cdfe0a01f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:40.466763 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-67ecf686-3ea5-4d74-b005-ef8cdfe0a01f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:40.499751 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-67ecf686-3ea5-4d74-b005-ef8cdfe0a01f tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050406 Jun 23 10:56:40.500321 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 371/770] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:56:40 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:40.696731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:40.697276 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:40.704174 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:40.704624 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:40.706036 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:40.706642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:40.837941 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:40.845806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:40.847468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:40.848898 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4815b449-da0a-4b30-ac6a-4cacd6db53a2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.155963 Jun 23 10:56:40.849253 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 400/771] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:40 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:41.515845 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-86a2d6f9-bce0-4002-bbe0-d162fb289003 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:41.516915 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-86a2d6f9-bce0-4002-bbe0-d162fb289003 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:41.531982 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86a2d6f9-bce0-4002-bbe0-d162fb289003 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:41.532635 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86a2d6f9-bce0-4002-bbe0-d162fb289003 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:41.533476 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86a2d6f9-bce0-4002-bbe0-d162fb289003 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:41.534590 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86a2d6f9-bce0-4002-bbe0-d162fb289003 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:41.562645 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=100 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:41.569062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-86a2d6f9-bce0-4002-bbe0-d162fb289003 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057856 Jun 23 10:56:41.569621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 372/772] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:56:41 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:41.868525 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:41.869160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:41.875598 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:41.876043 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:41.876807 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:41.877238 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:42.009386 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:42.017298 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:42.019031 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:42.020142 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-73cf261a-1ece-459c-ab84-87c7eb5deeee tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.155747 Jun 23 10:56:42.020692 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 401/773] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:41 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:42.581454 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4028423a-b4ac-44aa-9b03-314e8f673598 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:42.582459 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4028423a-b4ac-44aa-9b03-314e8f673598 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:42.593408 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4028423a-b4ac-44aa-9b03-314e8f673598 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:42.595252 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4028423a-b4ac-44aa-9b03-314e8f673598 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:42.597105 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4028423a-b4ac-44aa-9b03-314e8f673598 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:42.597544 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4028423a-b4ac-44aa-9b03-314e8f673598 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:42.626738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4028423a-b4ac-44aa-9b03-314e8f673598 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049737 Jun 23 10:56:42.627815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 373/774] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:56:42 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 10:56:42.637462 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:42.637943 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:42.644689 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:42.645133 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:42.645892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:42.647423 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:42.720149 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] HTTP exception thrown: Instance a7546151-13d3-41c1-b4df-a064682f764a is not attached to volume 30a99c7a-697c-41e6-aad7-3a02f5e46881 Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Request method failure captured: Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: DELETE /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments/30a99c7a-697c-41e6-aad7-3a02f5e46881 HTTP/1.1 Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEXi10mY7g-_5Bc7tun4gi53F7HcMJaciQldxMIQqOkwN6DCm97Y1jB3eO3msJWctsbgNadq6rOmHoBScdF8UqlmZFqLli96qScG79KOzZpsLV00RCt9uUy-sKd4KAfWpnbDb8jlaozBIGyD7UCJemoSCLpkKkrbr2hBBQh5a-AJXsA Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 9024c2d0554a4270bbc9222800e9dcb6 Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-TestMinimumBasicScenario-555194801 Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:56:42.731126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9024c2d0554a4270bbc9222800e9dcb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9024c2d0554a4270bbc9222800e9dcb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9024c2d0554a4270bbc9222800e9dcb6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9024c2d0554a4270bbc9222800e9dcb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-TestMinimumBasicScenario-555194801 Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 9024c2d0554a4270bbc9222800e9dcb6 Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-TestMinimumBasicScenario-555194801 Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-TestMinimumBasicScenario-555194801-project Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 6dbb7fcbd9604a87a8b4dd380ca9cd56 Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-TestMinimumBasicScenario-555194801-project Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:56:42.732726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance a7546151-13d3-41c1-b4df-a064682f764a is not attached to volume 30a99c7a-697c-41e6-aad7-3a02f5e46881 Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'server_id': 'a7546151-13d3-41c1-b4df-a064682f764a', 'id': '30a99c7a-697c-41e6-aad7-3a02f5e46881'} Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 30a99c7a-697c-41e6-aad7-3a02f5e46881. Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:56:42.733676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7546151-13d3-41c1-b4df-a064682f764a is not attached to volume 30a99c7a-697c-41e6-aad7-3a02f5e46881 Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7546151-13d3-41c1-b4df-a064682f764a is not attached to volume 30a99c7a-697c-41e6-aad7-3a02f5e46881 Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:42.735102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Returning 404 to user: Instance a7546151-13d3-41c1-b4df-a064682f764a is not attached to volume 30a99c7a-697c-41e6-aad7-3a02f5e46881 {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:56:42.736173 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-aba12c1f-b4bf-46be-b670-120b5ff3869c tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments/30a99c7a-697c-41e6-aad7-3a02f5e46881" status: 404 len: 154 microversion: 2.1 time: 0.098940 Jun 23 10:56:42.736173 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 402/775] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 10:56:42 2022] DELETE /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a/os-volume_attachments/30a99c7a-697c-41e6-aad7-3a02f5e46881 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:56:43.039094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:43.039706 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:43.045962 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:43.046445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:43.047320 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:43.047836 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:43.188877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:43.197162 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:43.198652 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:43.199766 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d685b59f-75c9-4da7-af3d-3eef61e0ee65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.164593 Jun 23 10:56:43.200534 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 374/776] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:43 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:43.866973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-aac93aa4-ef19-4526-a17e-6c6117173f16 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:43.867467 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-aac93aa4-ef19-4526-a17e-6c6117173f16 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:43.869833 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=6 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:43.875299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-aac93aa4-ef19-4526-a17e-6c6117173f16 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:43.875738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-aac93aa4-ef19-4526-a17e-6c6117173f16 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:43.876486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-aac93aa4-ef19-4526-a17e-6c6117173f16 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:43.876913 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-aac93aa4-ef19-4526-a17e-6c6117173f16 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:43.903745 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-aac93aa4-ef19-4526-a17e-6c6117173f16 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:56:43.976552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-aac93aa4-ef19-4526-a17e-6c6117173f16 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 204 len: 0 microversion: 2.1 time: 0.113230 Jun 23 10:56:43.977308 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 403/777] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:56:43 2022] DELETE /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 10:56:43.986017 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0b879e26-3df6-48cf-b77a-51f0ade6e7c8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:43.986649 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-0b879e26-3df6-48cf-b77a-51f0ade6e7c8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:43.989558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:43.990266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=6 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:43.996832 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0b879e26-3df6-48cf-b77a-51f0ade6e7c8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:43.997274 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0b879e26-3df6-48cf-b77a-51f0ade6e7c8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:43.998034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0b879e26-3df6-48cf-b77a-51f0ade6e7c8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:43.998497 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0b879e26-3df6-48cf-b77a-51f0ade6e7c8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:44.128234 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-0b879e26-3df6-48cf-b77a-51f0ade6e7c8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:44.136019 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0b879e26-3df6-48cf-b77a-51f0ade6e7c8 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1554 microversion: 2.1 time: 0.153847 Jun 23 10:56:44.136576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 375/778] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:43 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:44.218689 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:44.219385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:44.226144 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:44.226633 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:44.227399 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:44.227835 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:44.357288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:44.365510 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:44.367062 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:44.368163 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-20ce73b8-e715-4b97-87ca-f0c44720e39a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.153735 Jun 23 10:56:44.368711 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 404/779] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:44 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:44.514991 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-96394cb1-c9c3-4af2-b27e-b55456a3f904 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:44.515483 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-96394cb1-c9c3-4af2-b27e-b55456a3f904 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:44.522085 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96394cb1-c9c3-4af2-b27e-b55456a3f904 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:44.522560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96394cb1-c9c3-4af2-b27e-b55456a3f904 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:44.523320 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96394cb1-c9c3-4af2-b27e-b55456a3f904 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:44.523753 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96394cb1-c9c3-4af2-b27e-b55456a3f904 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:44.548623 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-96394cb1-c9c3-4af2-b27e-b55456a3f904 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Going to try to terminate instance {{(pid=129461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:56:44.624487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-96394cb1-c9c3-4af2-b27e-b55456a3f904 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 204 len: 0 microversion: 2.1 time: 0.113010 Jun 23 10:56:44.625054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 376/780] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:56:44 2022] DELETE /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:56:44.633636 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-27e7265c-03da-43ea-a62a-35d390e578f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:44.634254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-27e7265c-03da-43ea-a62a-35d390e578f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:44.640440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-27e7265c-03da-43ea-a62a-35d390e578f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:44.640891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-27e7265c-03da-43ea-a62a-35d390e578f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:44.641655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-27e7265c-03da-43ea-a62a-35d390e578f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:44.642094 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-27e7265c-03da-43ea-a62a-35d390e578f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:44.775458 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-27e7265c-03da-43ea-a62a-35d390e578f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:44.783023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-27e7265c-03da-43ea-a62a-35d390e578f1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1578 microversion: 2.1 time: 0.153252 Jun 23 10:56:44.783583 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 405/781] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:44 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:45.122499 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-24d404f5-87ad-4602-b192-6651b2ec8683 req-fda2b6a1-fcce-49b0-a578-936b0a661006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf2c8ff-3746-44d7-9eeb-96dc1c860432", "name": "network-vif-plugged", "status": "completed", "tag": "42635af4-43f0-435c-bf3e-bc1aabbcf87a"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:45.131314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-24d404f5-87ad-4602-b192-6651b2ec8683 req-fda2b6a1-fcce-49b0-a578-936b0a661006 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:45.131780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-24d404f5-87ad-4602-b192-6651b2ec8683 req-fda2b6a1-fcce-49b0-a578-936b0a661006 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:45.143488 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-24d404f5-87ad-4602-b192-6651b2ec8683 req-fda2b6a1-fcce-49b0-a578-936b0a661006 service nova] Creating event network-vif-plugged:42635af4-43f0-435c-bf3e-bc1aabbcf87a for instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 on hv-cinder-84614 Jun 23 10:56:45.148590 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-24d404f5-87ad-4602-b192-6651b2ec8683 req-fda2b6a1-fcce-49b0-a578-936b0a661006 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030097 Jun 23 10:56:45.149322 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 377/782] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:56:45.152929 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e1b7dc89-0246-4e3b-a16b-87df685a83e4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:45.153539 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e1b7dc89-0246-4e3b-a16b-87df685a83e4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:45.160351 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e1b7dc89-0246-4e3b-a16b-87df685a83e4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:45.160840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e1b7dc89-0246-4e3b-a16b-87df685a83e4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:45.161598 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e1b7dc89-0246-4e3b-a16b-87df685a83e4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:45.162026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e1b7dc89-0246-4e3b-a16b-87df685a83e4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:45.294172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e1b7dc89-0246-4e3b-a16b-87df685a83e4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:45.301612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e1b7dc89-0246-4e3b-a16b-87df685a83e4 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1554 microversion: 2.1 time: 0.152430 Jun 23 10:56:45.302165 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 406/783] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:45 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:45.385593 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:45.386292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:45.392611 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:45.393055 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:45.393815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:45.395045 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:45.536677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:45.544829 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:45.546353 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:45.547449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3012bb7a-11a8-4d25-853f-35421d1a4dff tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.166137 Jun 23 10:56:45.547987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 378/784] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:45 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:45.800888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7a3fc539-fa88-452f-a5ec-9aa6aac19cde tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:45.801397 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7a3fc539-fa88-452f-a5ec-9aa6aac19cde tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:45.807408 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a3fc539-fa88-452f-a5ec-9aa6aac19cde tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:45.807844 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a3fc539-fa88-452f-a5ec-9aa6aac19cde tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:45.808590 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a3fc539-fa88-452f-a5ec-9aa6aac19cde tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:45.809014 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a3fc539-fa88-452f-a5ec-9aa6aac19cde tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:45.939160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7a3fc539-fa88-452f-a5ec-9aa6aac19cde tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:45.947133 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7a3fc539-fa88-452f-a5ec-9aa6aac19cde tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1578 microversion: 2.1 time: 0.150375 Jun 23 10:56:45.947680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 407/785] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:45 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:46.318500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0f121d07-7cf6-4551-b3c2-201977fc9897 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:46.319099 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-0f121d07-7cf6-4551-b3c2-201977fc9897 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:46.325444 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0f121d07-7cf6-4551-b3c2-201977fc9897 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:46.326147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0f121d07-7cf6-4551-b3c2-201977fc9897 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:46.326920 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0f121d07-7cf6-4551-b3c2-201977fc9897 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:46.327343 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0f121d07-7cf6-4551-b3c2-201977fc9897 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:46.461235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-0f121d07-7cf6-4551-b3c2-201977fc9897 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:46.468695 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0f121d07-7cf6-4551-b3c2-201977fc9897 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1554 microversion: 2.1 time: 0.154283 Jun 23 10:56:46.469257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 379/786] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:46 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:46.564948 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:46.565552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:46.573127 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:46.573516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:46.574271 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:46.574727 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:46.732745 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:46.741242 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:46.743194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:46.744358 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6b261a7d-44ff-4a8a-99a0-05ac7b6b75c1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.183328 Jun 23 10:56:46.744912 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 408/787] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:46 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:46.964997 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a16c9fe9-8076-4de6-9a08-a1c52093f617 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:46.965513 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a16c9fe9-8076-4de6-9a08-a1c52093f617 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:46.971469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a16c9fe9-8076-4de6-9a08-a1c52093f617 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:46.971904 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a16c9fe9-8076-4de6-9a08-a1c52093f617 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:46.972790 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a16c9fe9-8076-4de6-9a08-a1c52093f617 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:46.973230 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a16c9fe9-8076-4de6-9a08-a1c52093f617 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:47.103282 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a16c9fe9-8076-4de6-9a08-a1c52093f617 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:47.110757 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a16c9fe9-8076-4de6-9a08-a1c52093f617 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1578 microversion: 2.1 time: 0.149637 Jun 23 10:56:47.111314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 380/788] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:46 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:47.485081 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2f5c1967-ad68-4727-b557-c4356003ef8e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:47.485780 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2f5c1967-ad68-4727-b557-c4356003ef8e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:47.492398 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f5c1967-ad68-4727-b557-c4356003ef8e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:47.492838 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f5c1967-ad68-4727-b557-c4356003ef8e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:47.493586 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f5c1967-ad68-4727-b557-c4356003ef8e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:47.494016 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f5c1967-ad68-4727-b557-c4356003ef8e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:47.509052 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:47.630217 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2f5c1967-ad68-4727-b557-c4356003ef8e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:47.637733 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2f5c1967-ad68-4727-b557-c4356003ef8e tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1554 microversion: 2.1 time: 0.156588 Jun 23 10:56:47.638285 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 409/789] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:47 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:47.762060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:47.762757 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:47.769425 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:47.769864 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:47.770650 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:47.771079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:47.903948 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:47.912610 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:47.914081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:47.915326 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-76d3c290-04bd-4be7-9259-ac1f49fd9402 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.157166 Jun 23 10:56:47.915886 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 381/790] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:47 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:48.007829 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-0bd0e9a7-6a6e-480a-bffa-1adb18866f2b req-b7666627-49cb-4fbc-91a3-e3809c63b9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7546151-13d3-41c1-b4df-a064682f764a", "name": "network-vif-deleted", "tag": "e3febbb8-c828-460d-9a89-e3851649705f"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:48.016071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-0bd0e9a7-6a6e-480a-bffa-1adb18866f2b req-b7666627-49cb-4fbc-91a3-e3809c63b9bc service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:48.016456 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-0bd0e9a7-6a6e-480a-bffa-1adb18866f2b req-b7666627-49cb-4fbc-91a3-e3809c63b9bc service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:48.028246 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-0bd0e9a7-6a6e-480a-bffa-1adb18866f2b req-b7666627-49cb-4fbc-91a3-e3809c63b9bc service nova] Creating event network-vif-deleted:e3febbb8-c828-460d-9a89-e3851649705f for instance a7546151-13d3-41c1-b4df-a064682f764a on hv-cinder-84614 Jun 23 10:56:48.033440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-0bd0e9a7-6a6e-480a-bffa-1adb18866f2b req-b7666627-49cb-4fbc-91a3-e3809c63b9bc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029626 Jun 23 10:56:48.034213 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 410/791] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:48.128288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e54735fd-7ec6-462d-b7bb-16f8d87408ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:48.128938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e54735fd-7ec6-462d-b7bb-16f8d87408ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:48.135104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e54735fd-7ec6-462d-b7bb-16f8d87408ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:48.135557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e54735fd-7ec6-462d-b7bb-16f8d87408ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:48.136325 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e54735fd-7ec6-462d-b7bb-16f8d87408ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:48.136765 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e54735fd-7ec6-462d-b7bb-16f8d87408ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:48.197990 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e54735fd-7ec6-462d-b7bb-16f8d87408ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:48.205759 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e54735fd-7ec6-462d-b7bb-16f8d87408ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1510 microversion: 2.1 time: 0.081413 Jun 23 10:56:48.206294 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 382/792] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:48 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1510 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:48.655853 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:48.656638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:48.663604 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:48.664121 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:48.664948 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:48.665462 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:48.702585 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:48.703034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:48.703480 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lazy-loading 'fault' on Instance uuid a7546151-13d3-41c1-b4df-a064682f764a {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:56:48.748084 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb7fcbd9604a87a8b4dd380ca9cd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9024c2d0554a4270bbc9222800e9dcb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:48.756104 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d3efcd18-8b89-4fa6-b001-bd66117720f2 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 200 len: 1348 microversion: 2.1 time: 0.104923 Jun 23 10:56:48.756670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 411/793] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:48 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:48.933062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:48.933666 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:48.950625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:48.951336 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:48.952136 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:48.952565 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:49.088071 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:49.096298 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:49.098577 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:49.099710 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7199562f-1a43-4eda-a946-4eec8363c2b6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1407 microversion: 2.20 time: 0.170552 Jun 23 10:56:49.100255 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 383/794] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:48 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:49.225021 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:49.225808 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:49.231983 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:49.232432 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:49.233201 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:49.233634 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:49.266790 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:49.267236 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:49.267682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lazy-loading 'fault' on Instance uuid b963bbb2-e54a-4996-82eb-ab728b7f94d4 {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:56:49.310701 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:49.319372 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2a87c1ca-b3f5-456f-a44e-7b12cad74835 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 200 len: 1230 microversion: 2.1 time: 0.099415 Jun 23 10:56:49.319937 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 412/795] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:49 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:49.775001 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:49.775609 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] [instance: a7546151-13d3-41c1-b4df-a064682f764a] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:49.781705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:49.782485 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:49.783252 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:49.783713 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:49.800355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] HTTP exception thrown: Instance a7546151-13d3-41c1-b4df-a064682f764a could not be found. Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Request method failure captured: Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a HTTP/1.1 Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEXi10mY7g-_5Bc7tun4gi53F7HcMJaciQldxMIQqOkwN6DCm97Y1jB3eO3msJWctsbgNadq6rOmHoBScdF8UqlmZFqLli96qScG79KOzZpsLV00RCt9uUy-sKd4KAfWpnbDb8jlaozBIGyD7UCJemoSCLpkKkrbr2hBBQh5a-AJXsA Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 9024c2d0554a4270bbc9222800e9dcb6 Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-TestMinimumBasicScenario-555194801 Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:56:49.802576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9024c2d0554a4270bbc9222800e9dcb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9024c2d0554a4270bbc9222800e9dcb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9024c2d0554a4270bbc9222800e9dcb6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9024c2d0554a4270bbc9222800e9dcb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-TestMinimumBasicScenario-555194801 Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 9024c2d0554a4270bbc9222800e9dcb6 Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-TestMinimumBasicScenario-555194801 Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-TestMinimumBasicScenario-555194801-project Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: 6dbb7fcbd9604a87a8b4dd380ca9cd56 Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-TestMinimumBasicScenario-555194801-project Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance a7546151-13d3-41c1-b4df-a064682f764a could not be found. Jun 23 10:56:49.804094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': 'a7546151-13d3-41c1-b4df-a064682f764a'} Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7546151-13d3-41c1-b4df-a064682f764a could not be found. Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:56:49.804941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7546151-13d3-41c1-b4df-a064682f764a could not be found. Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7546151-13d3-41c1-b4df-a064682f764a could not be found. Jun 23 10:56:49.806374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:56:49.807613 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Returning 404 to user: Instance a7546151-13d3-41c1-b4df-a064682f764a could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:56:49.807613 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-033c0b38-b443-4a23-82c6-40d45029acd5 tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a" status: 404 len: 111 microversion: 2.1 time: 0.034690 Jun 23 10:56:49.807613 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 384/796] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:49 2022] GET /compute/v2.1/servers/a7546151-13d3-41c1-b4df-a064682f764a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:56:49.812927 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d19dfb70-71cc-44ee-a15f-b6551e9669de tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] Calling method '.version_select at 0x7f8dc921b3a0>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:49.829846 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d19dfb70-71cc-44ee-a15f-b6551e9669de tempest-TestMinimumBasicScenario-555194801 tempest-TestMinimumBasicScenario-555194801-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-725333457" status: 202 len: 0 microversion: 2.1 time: 0.020730 Jun 23 10:56:49.830475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 413/797] 10.222.0.39 () {58 vars in 1268 bytes} [Thu Jun 23 10:56:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-725333457 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:56:50.050902 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-a89c5787-83d7-41e8-b4d6-fb3c1e4a74ba req-8f8ce951-2908-4a5d-bb39-00b8f7690528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b963bbb2-e54a-4996-82eb-ab728b7f94d4", "name": "network-vif-deleted", "tag": "e1aeaec1-0538-4618-bebe-dcb4ef7dba29"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:50.059211 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-a89c5787-83d7-41e8-b4d6-fb3c1e4a74ba req-8f8ce951-2908-4a5d-bb39-00b8f7690528 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:50.059667 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-a89c5787-83d7-41e8-b4d6-fb3c1e4a74ba req-8f8ce951-2908-4a5d-bb39-00b8f7690528 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:50.071367 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-a89c5787-83d7-41e8-b4d6-fb3c1e4a74ba req-8f8ce951-2908-4a5d-bb39-00b8f7690528 service nova] Creating event network-vif-deleted:e1aeaec1-0538-4618-bebe-dcb4ef7dba29 for instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 on hv-cinder-84614 Jun 23 10:56:50.076418 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-a89c5787-83d7-41e8-b4d6-fb3c1e4a74ba req-8f8ce951-2908-4a5d-bb39-00b8f7690528 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028948 Jun 23 10:56:50.077016 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 385/798] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:50.117632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:50.118110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:50.120081 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:50.126305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:50.126775 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:50.127550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:50.127983 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:50.272557 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:50.280496 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:50.282199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:50.283448 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4493e8f7-9209-4ded-8db6-099e7487895f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1598 microversion: 2.20 time: 0.170444 Jun 23 10:56:50.283997 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 414/799] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:56:50 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:50.301576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7263c2be-7a58-4640-bfbb-29311fe4f4f1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:50.302144 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7263c2be-7a58-4640-bfbb-29311fe4f4f1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:50.308323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7263c2be-7a58-4640-bfbb-29311fe4f4f1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:50.308767 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7263c2be-7a58-4640-bfbb-29311fe4f4f1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:50.309517 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7263c2be-7a58-4640-bfbb-29311fe4f4f1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:50.309941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7263c2be-7a58-4640-bfbb-29311fe4f4f1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:50.338124 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:50.339058 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:50.345456 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:50.345967 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:50.347076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:50.347829 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:50.361406 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] HTTP exception thrown: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Request method failure captured: Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 HTTP/1.1 Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEYNPhIHNrta-Ij_Wdy6in3BCJEwZbBcIb35A35e7f2Ydi1faIUvhInEo139qko6k2KU3Pte0GliMJhDTlfEowCqoPt7J83Hiiq4DAvuduVx5U-Jiew37nQbogcLdJCL1awC3QFEStG4F0ZkTmZj5r_Uqv-9cg4h5OgxQLysLtqoQ0I Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:56:50.363369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_79dbb107721b4406b5c3e2f5081034fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-TestVolumeBootPattern-402649719 Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-TestVolumeBootPattern-402649719-project Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 10ae039c34c442f880c51aaf9024db8d Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-TestVolumeBootPattern-402649719-project Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 10:56:50.365026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'b963bbb2-e54a-4996-82eb-ab728b7f94d4'} Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:56:50.365902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 10:56:50.368033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:56:50.369194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Returning 404 to user: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:56:50.369194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-50099753-1418-46c2-9717-e007ba815b9e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 404 len: 111 microversion: 2.1 time: 0.031507 Jun 23 10:56:50.369194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 415/800] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:50 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:56:50.443314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7263c2be-7a58-4640-bfbb-29311fe4f4f1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145063 Jun 23 10:56:50.444448 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 386/801] 10.222.0.39 () {60 vars in 1315 bytes} [Thu Jun 23 10:56:50 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:56:50.483597 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-158628001", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1984337626", "security_groups": [{"name": "tempest-secgroup-smoke-1207352602"}], "block_device_mapping_v2": [{"uuid": "67237f77-0558-4bde-abd2-5ed054cc4233", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d50fe3b-1b55-47cc-8ab0-a390036040cd"}]}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:50.665097 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.network.neutron [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] validate_networks() for [('7d50fe3b-1b55-47cc-8ab0-a390036040cd', None, None, None, None, None)] {{(pid=129460) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:56:51.660929 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Flavor limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:56:51.661531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Image limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:56:51.662010 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Flavor pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:56:51.662991 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Image pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:56:51.663233 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:56:51.672687 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:51.673131 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:51.673914 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:51.674369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:51.692568 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Getting quotas for project 79dbb107721b4406b5c3e2f5081034fd. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:56:51.696488 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Getting quotas for user 10ae039c34c442f880c51aaf9024db8d and project 79dbb107721b4406b5c3e2f5081034fd. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:56:51.756319 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Going to run 1 instances... {{(pid=129460) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:56:51.758407 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67237f77-0558-4bde-abd2-5ed054cc4233',volume_size=None,volume_type=None)] {{(pid=129460) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:56:51.939217 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-42f9b5bb-63e4-4e10-8a35-38efacf46ba7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.459140 Jun 23 10:56:51.951988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-cbd8744a-f246-4ddf-abe7-bcfb087decf3 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:51.953185 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-cbd8744a-f246-4ddf-abe7-bcfb087decf3 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:51.959087 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 416/802] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:56:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:56:52.046710 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cbd8744a-f246-4ddf-abe7-bcfb087decf3 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:52.053854 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-cbd8744a-f246-4ddf-abe7-bcfb087decf3 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1094 microversion: 2.1 time: 0.106358 Jun 23 10:56:52.057402 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 387/803] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:51 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1094 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:52.091512 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-48042781-fbd0-4717-97a4-4a5dd5fbe0e6 req-17531626-c715-43cf-8086-c7aa56337d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf2c8ff-3746-44d7-9eeb-96dc1c860432", "tag": "42635af4-43f0-435c-bf3e-bc1aabbcf87a"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:52.106731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-48042781-fbd0-4717-97a4-4a5dd5fbe0e6 req-17531626-c715-43cf-8086-c7aa56337d78 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:52.107182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-48042781-fbd0-4717-97a4-4a5dd5fbe0e6 req-17531626-c715-43cf-8086-c7aa56337d78 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:52.120018 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-48042781-fbd0-4717-97a4-4a5dd5fbe0e6 req-17531626-c715-43cf-8086-c7aa56337d78 service nova] Creating event network-changed:42635af4-43f0-435c-bf3e-bc1aabbcf87a for instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 on hv-cinder-84614 Jun 23 10:56:52.125327 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-48042781-fbd0-4717-97a4-4a5dd5fbe0e6 req-17531626-c715-43cf-8086-c7aa56337d78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037594 Jun 23 10:56:52.129259 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 417/804] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:53.074339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b4cc4c83-4535-47bc-8c7a-495252749aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:53.075411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b4cc4c83-4535-47bc-8c7a-495252749aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:53.084194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b4cc4c83-4535-47bc-8c7a-495252749aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:53.085898 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b4cc4c83-4535-47bc-8c7a-495252749aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:53.087374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b4cc4c83-4535-47bc-8c7a-495252749aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:53.088037 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b4cc4c83-4535-47bc-8c7a-495252749aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:53.170961 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b4cc4c83-4535-47bc-8c7a-495252749aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:53.181781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b4cc4c83-4535-47bc-8c7a-495252749aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1200 microversion: 2.1 time: 0.111127 Jun 23 10:56:53.182617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 388/805] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:53 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1200 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:54.201361 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-37587989-6608-4ce6-a97a-c310262dd50f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:54.202663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-37587989-6608-4ce6-a97a-c310262dd50f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:54.210189 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37587989-6608-4ce6-a97a-c310262dd50f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:54.210826 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37587989-6608-4ce6-a97a-c310262dd50f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:54.211974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37587989-6608-4ce6-a97a-c310262dd50f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:54.212598 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37587989-6608-4ce6-a97a-c310262dd50f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:54.525212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-37587989-6608-4ce6-a97a-c310262dd50f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:54.534190 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-37587989-6608-4ce6-a97a-c310262dd50f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.337435 Jun 23 10:56:54.537151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 418/806] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:54 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:55.114340 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-213d6e4c-bf38-461e-be18-9fc39b00c04c req-87a3527c-20c1-45a9-b77d-3aefb66bf9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72946e4-9448-4001-95ad-e03543a36ac8", "tag": "e8d735e0-24ce-4fb3-99e3-2718d4a783c8"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:56:55.134620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-213d6e4c-bf38-461e-be18-9fc39b00c04c req-87a3527c-20c1-45a9-b77d-3aefb66bf9f4 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:55.135061 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-213d6e4c-bf38-461e-be18-9fc39b00c04c req-87a3527c-20c1-45a9-b77d-3aefb66bf9f4 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:55.147157 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-213d6e4c-bf38-461e-be18-9fc39b00c04c req-87a3527c-20c1-45a9-b77d-3aefb66bf9f4 service nova] Creating event network-changed:e8d735e0-24ce-4fb3-99e3-2718d4a783c8 for instance f72946e4-9448-4001-95ad-e03543a36ac8 on hv-cinder-84614 Jun 23 10:56:55.152268 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-213d6e4c-bf38-461e-be18-9fc39b00c04c req-87a3527c-20c1-45a9-b77d-3aefb66bf9f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051549 Jun 23 10:56:55.153182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 389/807] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:55.552329 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-664f6208-7e99-4df4-8005-972e215d788e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:55.553582 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-664f6208-7e99-4df4-8005-972e215d788e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:55.560593 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-664f6208-7e99-4df4-8005-972e215d788e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:55.561293 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-664f6208-7e99-4df4-8005-972e215d788e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:55.562242 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-664f6208-7e99-4df4-8005-972e215d788e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:55.562699 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-664f6208-7e99-4df4-8005-972e215d788e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:55.788250 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-664f6208-7e99-4df4-8005-972e215d788e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:55.796096 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-664f6208-7e99-4df4-8005-972e215d788e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.247639 Jun 23 10:56:55.796939 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 419/808] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:55 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:56.814543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b66636e2-728a-4be5-a1c3-b298f35b9123 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:56.816206 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b66636e2-728a-4be5-a1c3-b298f35b9123 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:56.822987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b66636e2-728a-4be5-a1c3-b298f35b9123 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:56.823512 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b66636e2-728a-4be5-a1c3-b298f35b9123 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:56.824489 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b66636e2-728a-4be5-a1c3-b298f35b9123 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:56.825139 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b66636e2-728a-4be5-a1c3-b298f35b9123 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:57.056714 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b66636e2-728a-4be5-a1c3-b298f35b9123 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:57.070841 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b66636e2-728a-4be5-a1c3-b298f35b9123 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.261189 Jun 23 10:56:57.072128 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 390/809] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:56 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:57.151606 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0d0e7054-ff72-460d-9e1a-313807977928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:57.152164 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0d0e7054-ff72-460d-9e1a-313807977928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:57.158281 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0d0e7054-ff72-460d-9e1a-313807977928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:57.158779 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0d0e7054-ff72-460d-9e1a-313807977928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:57.159610 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0d0e7054-ff72-460d-9e1a-313807977928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:57.160166 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0d0e7054-ff72-460d-9e1a-313807977928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:57.251644 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-0d0e7054-ff72-460d-9e1a-313807977928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lazy-loading 'services' on Instance uuid b0b5388c-79f6-4797-a1b9-98518ed970ee {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:56:57.328822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0d0e7054-ff72-460d-9e1a-313807977928 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments/e06aea6a-c720-4a0b-9f67-7afe5462ee23" status: 202 len: 0 microversion: 2.1 time: 0.180883 Jun 23 10:56:57.329784 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 420/810] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 10:56:57 2022] DELETE /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments/e06aea6a-c720-4a0b-9f67-7afe5462ee23 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:56:57.337823 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-757a2b7c-5352-4a97-b451-4e17e9567803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:57.338898 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-757a2b7c-5352-4a97-b451-4e17e9567803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:57.345238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-757a2b7c-5352-4a97-b451-4e17e9567803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:57.345936 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-757a2b7c-5352-4a97-b451-4e17e9567803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:57.346766 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-757a2b7c-5352-4a97-b451-4e17e9567803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:57.347461 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-757a2b7c-5352-4a97-b451-4e17e9567803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:57.374858 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:57.380188 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-757a2b7c-5352-4a97-b451-4e17e9567803 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046312 Jun 23 10:56:57.380953 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 391/811] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:56:57 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:56:58.090274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-638d383b-4f2a-4c27-a746-f7b31325ec7d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:58.091617 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-638d383b-4f2a-4c27-a746-f7b31325ec7d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:58.099665 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-638d383b-4f2a-4c27-a746-f7b31325ec7d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:58.100200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-638d383b-4f2a-4c27-a746-f7b31325ec7d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:58.101288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-638d383b-4f2a-4c27-a746-f7b31325ec7d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:58.101921 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-638d383b-4f2a-4c27-a746-f7b31325ec7d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:58.389817 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-638d383b-4f2a-4c27-a746-f7b31325ec7d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:58.392726 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-66ad83d1-db8e-45c8-939c-b9f033116689 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:58.393587 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-66ad83d1-db8e-45c8-939c-b9f033116689 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:58.398885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-638d383b-4f2a-4c27-a746-f7b31325ec7d tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.313729 Jun 23 10:56:58.399642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 421/812] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:58 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:58.410153 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66ad83d1-db8e-45c8-939c-b9f033116689 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:58.410625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66ad83d1-db8e-45c8-939c-b9f033116689 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:58.411402 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66ad83d1-db8e-45c8-939c-b9f033116689 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:58.411834 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-66ad83d1-db8e-45c8-939c-b9f033116689 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:58.442635 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-66ad83d1-db8e-45c8-939c-b9f033116689 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053600 Jun 23 10:56:58.443209 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 392/813] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:56:58 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 10:56:58.522034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-31c47eaa-10b3-41e0-9ffe-75da42c48eec tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:58.522642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-31c47eaa-10b3-41e0-9ffe-75da42c48eec tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:58.532326 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-31c47eaa-10b3-41e0-9ffe-75da42c48eec tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:58.532874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-31c47eaa-10b3-41e0-9ffe-75da42c48eec tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:58.533723 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-31c47eaa-10b3-41e0-9ffe-75da42c48eec tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:58.534267 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-31c47eaa-10b3-41e0-9ffe-75da42c48eec tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:58.562254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-31c47eaa-10b3-41e0-9ffe-75da42c48eec tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:56:58.650051 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-31c47eaa-10b3-41e0-9ffe-75da42c48eec tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 204 len: 0 microversion: 2.1 time: 0.134935 Jun 23 10:56:58.650903 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 422/814] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:56:58 2022] DELETE /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:56:58.659967 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-50a36a40-8b19-424f-96e2-efc6377123db tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:58.661287 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-50a36a40-8b19-424f-96e2-efc6377123db tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:58.667297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-50a36a40-8b19-424f-96e2-efc6377123db tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:58.667870 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-50a36a40-8b19-424f-96e2-efc6377123db tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:58.668730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-50a36a40-8b19-424f-96e2-efc6377123db tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:58.669058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-50a36a40-8b19-424f-96e2-efc6377123db tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:58.834783 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-50a36a40-8b19-424f-96e2-efc6377123db tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:58.842230 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-50a36a40-8b19-424f-96e2-efc6377123db tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1689 microversion: 2.1 time: 0.186928 Jun 23 10:56:58.842922 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 393/815] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:58 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:59.416929 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f3886e27-ea82-4522-9850-c5f511c71b5b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:59.417809 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f3886e27-ea82-4522-9850-c5f511c71b5b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:59.426343 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f3886e27-ea82-4522-9850-c5f511c71b5b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:59.426781 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f3886e27-ea82-4522-9850-c5f511c71b5b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:59.427731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f3886e27-ea82-4522-9850-c5f511c71b5b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:59.428160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f3886e27-ea82-4522-9850-c5f511c71b5b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:59.597803 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f3886e27-ea82-4522-9850-c5f511c71b5b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:56:59.605521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f3886e27-ea82-4522-9850-c5f511c71b5b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.193493 Jun 23 10:56:59.606427 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 423/816] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:59 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:59.859907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-97f777d9-acac-41c3-b204-4096d438ddbe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:59.860505 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-97f777d9-acac-41c3-b204-4096d438ddbe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:56:59.868070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97f777d9-acac-41c3-b204-4096d438ddbe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:59.868746 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97f777d9-acac-41c3-b204-4096d438ddbe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:56:59.869498 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97f777d9-acac-41c3-b204-4096d438ddbe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:56:59.869927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97f777d9-acac-41c3-b204-4096d438ddbe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:00.000355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-97f777d9-acac-41c3-b204-4096d438ddbe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:00.008162 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-97f777d9-acac-41c3-b204-4096d438ddbe tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1689 microversion: 2.1 time: 0.152053 Jun 23 10:57:00.008721 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 394/817] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:56:59 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:00.622250 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9d227ff8-925f-47de-8a2a-588b499aa219 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:00.622885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9d227ff8-925f-47de-8a2a-588b499aa219 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:00.629342 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9d227ff8-925f-47de-8a2a-588b499aa219 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:00.629785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9d227ff8-925f-47de-8a2a-588b499aa219 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:00.630573 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9d227ff8-925f-47de-8a2a-588b499aa219 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:00.631008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9d227ff8-925f-47de-8a2a-588b499aa219 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:00.761269 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9d227ff8-925f-47de-8a2a-588b499aa219 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:00.768952 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9d227ff8-925f-47de-8a2a-588b499aa219 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.150453 Jun 23 10:57:00.769922 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 424/818] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:00 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:01.026122 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8af47cbf-4180-46bd-aab5-89bb48a1696b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:01.026766 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8af47cbf-4180-46bd-aab5-89bb48a1696b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:01.029009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:01.036195 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8af47cbf-4180-46bd-aab5-89bb48a1696b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:01.036649 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8af47cbf-4180-46bd-aab5-89bb48a1696b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:01.037435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8af47cbf-4180-46bd-aab5-89bb48a1696b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:01.038085 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8af47cbf-4180-46bd-aab5-89bb48a1696b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:01.168529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8af47cbf-4180-46bd-aab5-89bb48a1696b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:01.176443 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8af47cbf-4180-46bd-aab5-89bb48a1696b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1689 microversion: 2.1 time: 0.154099 Jun 23 10:57:01.177006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 395/819] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:01 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:01.786713 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9ce6c417-80b4-4612-83af-1dc9c792e2a8 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:01.787255 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9ce6c417-80b4-4612-83af-1dc9c792e2a8 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:01.789599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:01.790469 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=6 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:01.795788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9ce6c417-80b4-4612-83af-1dc9c792e2a8 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:01.796232 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9ce6c417-80b4-4612-83af-1dc9c792e2a8 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:01.796987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9ce6c417-80b4-4612-83af-1dc9c792e2a8 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:01.797444 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9ce6c417-80b4-4612-83af-1dc9c792e2a8 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:01.929209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9ce6c417-80b4-4612-83af-1dc9c792e2a8 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:01.936507 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9ce6c417-80b4-4612-83af-1dc9c792e2a8 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.154567 Jun 23 10:57:01.937057 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 425/820] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:01 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:02.193886 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-547637bf-6714-41c3-8a57-04481667ddf8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:02.194508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-547637bf-6714-41c3-8a57-04481667ddf8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:02.196799 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:02.202675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-547637bf-6714-41c3-8a57-04481667ddf8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:02.203150 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-547637bf-6714-41c3-8a57-04481667ddf8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:02.203906 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-547637bf-6714-41c3-8a57-04481667ddf8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:02.204337 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-547637bf-6714-41c3-8a57-04481667ddf8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:02.333846 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-547637bf-6714-41c3-8a57-04481667ddf8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:02.341199 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-547637bf-6714-41c3-8a57-04481667ddf8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1689 microversion: 2.1 time: 0.152125 Jun 23 10:57:02.341757 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 396/821] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:02 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:57:02.952467 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a3dd164c-88b9-49f1-8795-7f09a15b5b57 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:02.953072 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a3dd164c-88b9-49f1-8795-7f09a15b5b57 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:02.959923 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3dd164c-88b9-49f1-8795-7f09a15b5b57 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:02.960365 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3dd164c-88b9-49f1-8795-7f09a15b5b57 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:02.961117 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3dd164c-88b9-49f1-8795-7f09a15b5b57 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:02.961548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3dd164c-88b9-49f1-8795-7f09a15b5b57 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:03.091827 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a3dd164c-88b9-49f1-8795-7f09a15b5b57 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:03.093974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:03.101681 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a3dd164c-88b9-49f1-8795-7f09a15b5b57 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.153257 Jun 23 10:57:03.102234 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 426/822] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:02 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:03.358307 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-827a5b5b-fca0-47eb-a5d5-f593bf01cfa4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:03.358920 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-827a5b5b-fca0-47eb-a5d5-f593bf01cfa4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:03.365810 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-827a5b5b-fca0-47eb-a5d5-f593bf01cfa4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:03.366263 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-827a5b5b-fca0-47eb-a5d5-f593bf01cfa4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:03.367115 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-827a5b5b-fca0-47eb-a5d5-f593bf01cfa4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:03.367552 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-827a5b5b-fca0-47eb-a5d5-f593bf01cfa4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:03.496955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-827a5b5b-fca0-47eb-a5d5-f593bf01cfa4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:03.504900 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-827a5b5b-fca0-47eb-a5d5-f593bf01cfa4 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1689 microversion: 2.1 time: 0.150416 Jun 23 10:57:03.505461 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 397/823] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:03 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:04.119026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f2043698-04e4-4b72-bbb0-2d60666ca53b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:04.119741 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f2043698-04e4-4b72-bbb0-2d60666ca53b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:04.126853 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f2043698-04e4-4b72-bbb0-2d60666ca53b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:04.127305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f2043698-04e4-4b72-bbb0-2d60666ca53b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:04.128670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f2043698-04e4-4b72-bbb0-2d60666ca53b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:04.129710 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f2043698-04e4-4b72-bbb0-2d60666ca53b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:04.278541 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f2043698-04e4-4b72-bbb0-2d60666ca53b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:04.286018 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f2043698-04e4-4b72-bbb0-2d60666ca53b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.170858 Jun 23 10:57:04.286710 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 427/824] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:04 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:04.457956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-59beb313-7ab6-42f6-89b8-8badab0751c0 req-884f3473-f227-4fad-8ac9-84cd80c97963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b5388c-79f6-4797-a1b9-98518ed970ee", "name": "network-vif-deleted", "tag": "dd66f398-76e8-408c-bd60-d35c977b57e5"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:04.466697 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-59beb313-7ab6-42f6-89b8-8badab0751c0 req-884f3473-f227-4fad-8ac9-84cd80c97963 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:04.467246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-59beb313-7ab6-42f6-89b8-8badab0751c0 req-884f3473-f227-4fad-8ac9-84cd80c97963 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:04.479318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-59beb313-7ab6-42f6-89b8-8badab0751c0 req-884f3473-f227-4fad-8ac9-84cd80c97963 service nova] Creating event network-vif-deleted:dd66f398-76e8-408c-bd60-d35c977b57e5 for instance b0b5388c-79f6-4797-a1b9-98518ed970ee on hv-cinder-84614 Jun 23 10:57:04.484147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-59beb313-7ab6-42f6-89b8-8badab0751c0 req-884f3473-f227-4fad-8ac9-84cd80c97963 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030303 Jun 23 10:57:04.485189 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 398/825] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:04.521369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4e627888-a5b9-4837-bc39-78cac6d90c9b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:04.522755 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4e627888-a5b9-4837-bc39-78cac6d90c9b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:04.535625 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e627888-a5b9-4837-bc39-78cac6d90c9b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:04.536158 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e627888-a5b9-4837-bc39-78cac6d90c9b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:04.537069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e627888-a5b9-4837-bc39-78cac6d90c9b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:04.537583 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e627888-a5b9-4837-bc39-78cac6d90c9b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:04.617786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4e627888-a5b9-4837-bc39-78cac6d90c9b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:04.625780 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4e627888-a5b9-4837-bc39-78cac6d90c9b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 200 len: 1329 microversion: 2.1 time: 0.108467 Jun 23 10:57:04.626373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 428/826] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:04 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 1329 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:05.303903 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1c26c4d6-b97e-4476-a581-12baac1d0fa6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:05.304677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1c26c4d6-b97e-4476-a581-12baac1d0fa6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:05.311042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1c26c4d6-b97e-4476-a581-12baac1d0fa6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:05.311692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1c26c4d6-b97e-4476-a581-12baac1d0fa6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:05.312657 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1c26c4d6-b97e-4476-a581-12baac1d0fa6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:05.313093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1c26c4d6-b97e-4476-a581-12baac1d0fa6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:05.461020 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1c26c4d6-b97e-4476-a581-12baac1d0fa6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:05.470652 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1c26c4d6-b97e-4476-a581-12baac1d0fa6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.171588 Jun 23 10:57:05.471302 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 399/827] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:05 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:57:05.643196 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:05.643742 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: b0b5388c-79f6-4797-a1b9-98518ed970ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:05.652417 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:05.652888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:05.653905 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:05.654395 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:05.668311 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] HTTP exception thrown: Instance b0b5388c-79f6-4797-a1b9-98518ed970ee could not be found. Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Request method failure captured: Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee HTTP/1.1 Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgvRgPZd-B_64ft6SWQKWYQrdfYdRK3rH49v70jABcjg2aJorfdpCiePsKlYrulilBUvCm1hQU-ZZR_2zNn-lsf0oJgctRN6MpIzT7LQnot0J45gZ6Q13Fx1smgynpjCQiB_5V-vYmSFkjDF9UFZDCIuhAjfLfpTkGw4uI5ZAbF2E Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:57:05.670085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eacce04e67d14a2f8ae63f5cd115b69c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: d230950f9e984a8b878d7d0f74dda3ce Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance b0b5388c-79f6-4797-a1b9-98518ed970ee could not be found. Jun 23 10:57:05.671763 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'b0b5388c-79f6-4797-a1b9-98518ed970ee'} Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b5388c-79f6-4797-a1b9-98518ed970ee could not be found. Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:57:05.672684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b5388c-79f6-4797-a1b9-98518ed970ee could not be found. Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b5388c-79f6-4797-a1b9-98518ed970ee could not be found. Jun 23 10:57:05.674215 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:05.676417 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Returning 404 to user: Instance b0b5388c-79f6-4797-a1b9-98518ed970ee could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:57:05.676417 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-600c4a77-811b-4535-9ae3-ffafc50bb1f9 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee" status: 404 len: 111 microversion: 2.1 time: 0.032220 Jun 23 10:57:05.676417 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 429/828] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:05 2022] GET /compute/v2.1/servers/b0b5388c-79f6-4797-a1b9-98518ed970ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:57:05.681194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-65363c82-cc11-4399-a08d-c51da3050c9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '.version_select at 0x7f8dc92bfca0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:05.701999 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-65363c82-cc11-4399-a08d-c51da3050c9d tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-932832116" status: 202 len: 0 microversion: 2.1 time: 0.024575 Jun 23 10:57:05.702695 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 400/829] 10.222.0.39 () {58 vars in 1217 bytes} [Thu Jun 23 10:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-932832116 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:57:06.489492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fe2592e2-af1d-4630-9297-5fc46effeae6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:06.490311 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fe2592e2-af1d-4630-9297-5fc46effeae6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:06.496458 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe2592e2-af1d-4630-9297-5fc46effeae6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:06.496977 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe2592e2-af1d-4630-9297-5fc46effeae6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:06.497800 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe2592e2-af1d-4630-9297-5fc46effeae6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:06.498297 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe2592e2-af1d-4630-9297-5fc46effeae6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:06.640791 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fe2592e2-af1d-4630-9297-5fc46effeae6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:06.649818 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fe2592e2-af1d-4630-9297-5fc46effeae6 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.164732 Jun 23 10:57:06.650561 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 430/830] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:06 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:07.211774 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-f78652f6-2626-4b5c-b22f-9ab413caa36a req-915f4098-b45f-4e8f-b204-a9c5d9dfbc1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72946e4-9448-4001-95ad-e03543a36ac8", "name": "network-vif-plugged", "status": "completed", "tag": "e8d735e0-24ce-4fb3-99e3-2718d4a783c8"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:07.220949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-f78652f6-2626-4b5c-b22f-9ab413caa36a req-915f4098-b45f-4e8f-b204-a9c5d9dfbc1b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:07.221448 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-f78652f6-2626-4b5c-b22f-9ab413caa36a req-915f4098-b45f-4e8f-b204-a9c5d9dfbc1b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:07.234717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-f78652f6-2626-4b5c-b22f-9ab413caa36a req-915f4098-b45f-4e8f-b204-a9c5d9dfbc1b service nova] Creating event network-vif-plugged:e8d735e0-24ce-4fb3-99e3-2718d4a783c8 for instance f72946e4-9448-4001-95ad-e03543a36ac8 on hv-cinder-84614 Jun 23 10:57:07.240213 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-f78652f6-2626-4b5c-b22f-9ab413caa36a req-915f4098-b45f-4e8f-b204-a9c5d9dfbc1b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032615 Jun 23 10:57:07.240887 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 401/831] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:07.667615 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b3e6ae30-40c5-431b-90e8-cfaec2dc3cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:07.668212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b3e6ae30-40c5-431b-90e8-cfaec2dc3cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:07.674891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b3e6ae30-40c5-431b-90e8-cfaec2dc3cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:07.675957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b3e6ae30-40c5-431b-90e8-cfaec2dc3cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:07.676732 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b3e6ae30-40c5-431b-90e8-cfaec2dc3cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:07.677177 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b3e6ae30-40c5-431b-90e8-cfaec2dc3cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:07.812795 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b3e6ae30-40c5-431b-90e8-cfaec2dc3cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:07.821346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b3e6ae30-40c5-431b-90e8-cfaec2dc3cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.157609 Jun 23 10:57:07.821903 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 431/832] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:07 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:08.624944 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9db1b264-4d47-4d82-bf7c-ef3b3b15ada6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:08.625531 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9db1b264-4d47-4d82-bf7c-ef3b3b15ada6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:08.633991 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9db1b264-4d47-4d82-bf7c-ef3b3b15ada6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:08.634473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9db1b264-4d47-4d82-bf7c-ef3b3b15ada6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:08.635232 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9db1b264-4d47-4d82-bf7c-ef3b3b15ada6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:08.635661 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9db1b264-4d47-4d82-bf7c-ef3b3b15ada6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:08.660190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9db1b264-4d47-4d82-bf7c-ef3b3b15ada6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Going to try to terminate instance {{(pid=129461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:57:08.734826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9db1b264-4d47-4d82-bf7c-ef3b3b15ada6 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "DELETE /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 204 len: 0 microversion: 2.1 time: 0.113934 Jun 23 10:57:08.735410 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 402/833] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:57:08 2022] DELETE /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 10:57:08.743828 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-38862e8c-a027-400c-9ac7-8cc21dc67ece tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:08.744438 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-38862e8c-a027-400c-9ac7-8cc21dc67ece tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:08.750987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-38862e8c-a027-400c-9ac7-8cc21dc67ece tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:08.751376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-38862e8c-a027-400c-9ac7-8cc21dc67ece tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:08.752132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-38862e8c-a027-400c-9ac7-8cc21dc67ece tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:08.752568 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-38862e8c-a027-400c-9ac7-8cc21dc67ece tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:08.840492 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-23bf1b0d-47f5-4e25-ba9c-eccc8d16495a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:08.841289 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-23bf1b0d-47f5-4e25-ba9c-eccc8d16495a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:08.847948 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23bf1b0d-47f5-4e25-ba9c-eccc8d16495a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:08.848822 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23bf1b0d-47f5-4e25-ba9c-eccc8d16495a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:08.849981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23bf1b0d-47f5-4e25-ba9c-eccc8d16495a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:08.850444 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23bf1b0d-47f5-4e25-ba9c-eccc8d16495a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:08.908325 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-38862e8c-a027-400c-9ac7-8cc21dc67ece tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:08.915804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-38862e8c-a027-400c-9ac7-8cc21dc67ece tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1508 microversion: 2.1 time: 0.175794 Jun 23 10:57:08.916382 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 432/834] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:08 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:08.992387 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-23bf1b0d-47f5-4e25-ba9c-eccc8d16495a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:08.999727 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-23bf1b0d-47f5-4e25-ba9c-eccc8d16495a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1266 microversion: 2.1 time: 0.163847 Jun 23 10:57:09.000272 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 403/835] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:08 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:09.933848 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bcccf2c5-fc79-458f-9ebc-57054b756158 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:09.934481 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bcccf2c5-fc79-458f-9ebc-57054b756158 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:09.940976 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bcccf2c5-fc79-458f-9ebc-57054b756158 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:09.941429 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bcccf2c5-fc79-458f-9ebc-57054b756158 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:09.943229 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bcccf2c5-fc79-458f-9ebc-57054b756158 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:09.943674 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bcccf2c5-fc79-458f-9ebc-57054b756158 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:10.016837 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d76bf340-98b6-4b0d-82b1-0a26ac602ba2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:10.017452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d76bf340-98b6-4b0d-82b1-0a26ac602ba2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:10.024264 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d76bf340-98b6-4b0d-82b1-0a26ac602ba2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:10.024720 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d76bf340-98b6-4b0d-82b1-0a26ac602ba2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:10.025528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d76bf340-98b6-4b0d-82b1-0a26ac602ba2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:10.025968 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d76bf340-98b6-4b0d-82b1-0a26ac602ba2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:10.084051 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bcccf2c5-fc79-458f-9ebc-57054b756158 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:10.093278 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bcccf2c5-fc79-458f-9ebc-57054b756158 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1508 microversion: 2.1 time: 0.163308 Jun 23 10:57:10.093851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 433/836] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:09 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:10.171923 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d76bf340-98b6-4b0d-82b1-0a26ac602ba2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:10.179371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d76bf340-98b6-4b0d-82b1-0a26ac602ba2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1453 microversion: 2.1 time: 0.166357 Jun 23 10:57:10.180029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 404/837] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:10 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:57:10.195567 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-00d6a9fd-ed85-423c-84dc-f41f5a01b98c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:10.196240 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-00d6a9fd-ed85-423c-84dc-f41f5a01b98c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:10.202556 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-00d6a9fd-ed85-423c-84dc-f41f5a01b98c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:10.203002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-00d6a9fd-ed85-423c-84dc-f41f5a01b98c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:10.203762 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-00d6a9fd-ed85-423c-84dc-f41f5a01b98c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:10.204223 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-00d6a9fd-ed85-423c-84dc-f41f5a01b98c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:10.337337 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-00d6a9fd-ed85-423c-84dc-f41f5a01b98c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:10.344948 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-00d6a9fd-ed85-423c-84dc-f41f5a01b98c tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1453 microversion: 2.1 time: 0.153653 Jun 23 10:57:10.345499 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 434/838] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:10 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:11.110257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6cdf6f1d-c260-46a9-9e2a-ec4ac9fa1263 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:11.110876 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6cdf6f1d-c260-46a9-9e2a-ec4ac9fa1263 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:11.117937 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f1d-c260-46a9-9e2a-ec4ac9fa1263 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:11.118413 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f1d-c260-46a9-9e2a-ec4ac9fa1263 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:11.119174 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f1d-c260-46a9-9e2a-ec4ac9fa1263 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:11.119603 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f1d-c260-46a9-9e2a-ec4ac9fa1263 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:11.248903 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6cdf6f1d-c260-46a9-9e2a-ec4ac9fa1263 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:11.256305 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6cdf6f1d-c260-46a9-9e2a-ec4ac9fa1263 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1508 microversion: 2.1 time: 0.149918 Jun 23 10:57:11.256860 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 405/839] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:11 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:11.954636 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-339042df-c2f1-4025-b5e9-e34ce9d84d2e req-6aaa6000-c103-4d37-b568-80b882f8f365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288db671-2fdd-4a32-bc84-b325f6606ea1", "name": "network-vif-deleted", "tag": "3f493c22-ce91-4339-80e5-f1905a1b0046"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:11.964065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-339042df-c2f1-4025-b5e9-e34ce9d84d2e req-6aaa6000-c103-4d37-b568-80b882f8f365 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:11.964792 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-339042df-c2f1-4025-b5e9-e34ce9d84d2e req-6aaa6000-c103-4d37-b568-80b882f8f365 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:11.977639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-339042df-c2f1-4025-b5e9-e34ce9d84d2e req-6aaa6000-c103-4d37-b568-80b882f8f365 service nova] Creating event network-vif-deleted:3f493c22-ce91-4339-80e5-f1905a1b0046 for instance 288db671-2fdd-4a32-bc84-b325f6606ea1 on hv-cinder-84614 Jun 23 10:57:11.984076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-339042df-c2f1-4025-b5e9-e34ce9d84d2e req-6aaa6000-c103-4d37-b568-80b882f8f365 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 Jun 23 10:57:11.985447 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 435/840] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:57:12.273758 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:12.274407 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:12.281318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:12.281819 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:12.282561 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:12.283227 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:12.331584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:12.332961 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:12.333688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lazy-loading 'fault' on Instance uuid 288db671-2fdd-4a32-bc84-b325f6606ea1 {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:57:12.384292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:12.393698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8c1b7ab7-2d83-40ec-a1f5-c75aa2ef0bf1 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 200 len: 1312 microversion: 2.1 time: 0.124312 Jun 23 10:57:12.394404 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 406/841] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:12 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:13.412201 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:13.412900 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: 288db671-2fdd-4a32-bc84-b325f6606ea1] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:13.419203 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:13.419644 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:13.420412 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:13.420851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:13.435470 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] HTTP exception thrown: Instance 288db671-2fdd-4a32-bc84-b325f6606ea1 could not be found. Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Request method failure captured: Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 HTTP/1.1 Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgvRgPZd-B_64ft6SWQKWYQrdfYdRK3rH49v70jABcjg2aJorfdpCiePsKlYrulilBUvCm1hQU-ZZR_2zNn-lsf0oJgctRN6MpIzT7LQnot0J45gZ6Q13Fx1smgynpjCQiB_5V-vYmSFkjDF9UFZDCIuhAjfLfpTkGw4uI5ZAbF2E Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:57:13.437123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eacce04e67d14a2f8ae63f5cd115b69c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: d230950f9e984a8b878d7d0f74dda3ce Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 288db671-2fdd-4a32-bc84-b325f6606ea1 could not be found. Jun 23 10:57:13.438705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '288db671-2fdd-4a32-bc84-b325f6606ea1'} Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288db671-2fdd-4a32-bc84-b325f6606ea1 could not be found. Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:57:13.439584 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288db671-2fdd-4a32-bc84-b325f6606ea1 could not be found. Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288db671-2fdd-4a32-bc84-b325f6606ea1 could not be found. Jun 23 10:57:13.440825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:13.443093 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Returning 404 to user: Instance 288db671-2fdd-4a32-bc84-b325f6606ea1 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:57:13.443093 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-270f4c10-1831-42c8-83cf-a44a5d5b7ed8 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1" status: 404 len: 111 microversion: 2.1 time: 0.031578 Jun 23 10:57:13.443396 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 436/842] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:13 2022] GET /compute/v2.1/servers/288db671-2fdd-4a32-bc84-b325f6606ea1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:57:13.447708 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fa5f96bd-292f-4663-92c1-23a86a208b2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:13.448237 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fa5f96bd-292f-4663-92c1-23a86a208b2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:13.455204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa5f96bd-292f-4663-92c1-23a86a208b2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:13.455661 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa5f96bd-292f-4663-92c1-23a86a208b2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:13.456805 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa5f96bd-292f-4663-92c1-23a86a208b2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:13.456905 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa5f96bd-292f-4663-92c1-23a86a208b2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:13.484112 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fa5f96bd-292f-4663-92c1-23a86a208b2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Going to try to terminate instance {{(pid=129461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:57:13.521292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:13.569918 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fa5f96bd-292f-4663-92c1-23a86a208b2f tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 204 len: 0 microversion: 2.1 time: 0.125659 Jun 23 10:57:13.570781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 407/843] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:57:13 2022] DELETE /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:57:13.579416 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-800d1977-ed35-4604-aa46-1556dfeb320b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:13.580269 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-800d1977-ed35-4604-aa46-1556dfeb320b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:13.587440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-800d1977-ed35-4604-aa46-1556dfeb320b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:13.587980 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-800d1977-ed35-4604-aa46-1556dfeb320b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:13.588746 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-800d1977-ed35-4604-aa46-1556dfeb320b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:13.589185 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-800d1977-ed35-4604-aa46-1556dfeb320b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:13.728118 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-800d1977-ed35-4604-aa46-1556dfeb320b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:13.735851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-800d1977-ed35-4604-aa46-1556dfeb320b tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.160504 Jun 23 10:57:13.736403 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 437/844] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:13 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:14.009460 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-94cdc1dc-882b-4031-a379-62ed2af213f9 req-7692cb9c-fe11-4848-8796-6c19049d95d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72946e4-9448-4001-95ad-e03543a36ac8", "tag": "e8d735e0-24ce-4fb3-99e3-2718d4a783c8"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:14.017395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-94cdc1dc-882b-4031-a379-62ed2af213f9 req-7692cb9c-fe11-4848-8796-6c19049d95d1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:14.017826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-94cdc1dc-882b-4031-a379-62ed2af213f9 req-7692cb9c-fe11-4848-8796-6c19049d95d1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:14.028898 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-94cdc1dc-882b-4031-a379-62ed2af213f9 req-7692cb9c-fe11-4848-8796-6c19049d95d1 service nova] Creating event network-changed:e8d735e0-24ce-4fb3-99e3-2718d4a783c8 for instance f72946e4-9448-4001-95ad-e03543a36ac8 on hv-cinder-84614 Jun 23 10:57:14.033712 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-94cdc1dc-882b-4031-a379-62ed2af213f9 req-7692cb9c-fe11-4848-8796-6c19049d95d1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028275 Jun 23 10:57:14.034267 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 408/845] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:14.752928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-55edb49a-9804-45c7-b7df-89ee7dd54b8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:14.753530 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-55edb49a-9804-45c7-b7df-89ee7dd54b8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:14.760785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55edb49a-9804-45c7-b7df-89ee7dd54b8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:14.761225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55edb49a-9804-45c7-b7df-89ee7dd54b8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:14.761973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55edb49a-9804-45c7-b7df-89ee7dd54b8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:14.762430 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55edb49a-9804-45c7-b7df-89ee7dd54b8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:14.886987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-55edb49a-9804-45c7-b7df-89ee7dd54b8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:14.894422 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-55edb49a-9804-45c7-b7df-89ee7dd54b8c tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.145336 Jun 23 10:57:14.894995 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 438/846] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:14 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:15.912379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-505e74ab-2778-4a57-82ab-2415cd94fb24 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:15.913170 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-505e74ab-2778-4a57-82ab-2415cd94fb24 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:15.919440 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-505e74ab-2778-4a57-82ab-2415cd94fb24 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:15.919877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-505e74ab-2778-4a57-82ab-2415cd94fb24 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:15.920624 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-505e74ab-2778-4a57-82ab-2415cd94fb24 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:15.921048 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-505e74ab-2778-4a57-82ab-2415cd94fb24 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:16.050589 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-505e74ab-2778-4a57-82ab-2415cd94fb24 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:16.058743 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-505e74ab-2778-4a57-82ab-2415cd94fb24 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1521 microversion: 2.1 time: 0.151510 Jun 23 10:57:16.059314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 409/847] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:15 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:16.654221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-2df1dac8-58de-47a9-9ce4-6a5bf93b505e req-f63371e7-08d1-412d-bfef-fef1f5080329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdecdfe5-d298-4823-a396-cf390e769f92", "name": "network-vif-deleted", "tag": "62749cc8-f2ed-4f3d-857d-f18de666a6ca"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:16.667650 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-2df1dac8-58de-47a9-9ce4-6a5bf93b505e req-f63371e7-08d1-412d-bfef-fef1f5080329 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:16.668088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-2df1dac8-58de-47a9-9ce4-6a5bf93b505e req-f63371e7-08d1-412d-bfef-fef1f5080329 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:16.683746 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-2df1dac8-58de-47a9-9ce4-6a5bf93b505e req-f63371e7-08d1-412d-bfef-fef1f5080329 service nova] Creating event network-vif-deleted:62749cc8-f2ed-4f3d-857d-f18de666a6ca for instance bdecdfe5-d298-4823-a396-cf390e769f92 on hv-cinder-84614 Jun 23 10:57:16.689706 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-2df1dac8-58de-47a9-9ce4-6a5bf93b505e req-f63371e7-08d1-412d-bfef-fef1f5080329 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039181 Jun 23 10:57:16.690303 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 439/848] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:17.077454 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:17.078254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:17.086571 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:17.087020 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:17.087791 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:17.088226 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:17.124039 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:17.124495 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:17.124943 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lazy-loading 'fault' on Instance uuid bdecdfe5-d298-4823-a396-cf390e769f92 {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:57:17.170249 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd230950f9e984a8b878d7d0f74dda3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacce04e67d14a2f8ae63f5cd115b69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:17.178221 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f699196a-4cae-4543-a5c2-2cded5faf625 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 200 len: 1311 microversion: 2.1 time: 0.105628 Jun 23 10:57:17.178812 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 410/849] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:17 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:18.194806 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:18.195486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] [instance: bdecdfe5-d298-4823-a396-cf390e769f92] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:18.203067 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:18.203515 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:18.204276 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:18.204709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:18.218609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] HTTP exception thrown: Instance bdecdfe5-d298-4823-a396-cf390e769f92 could not be found. Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Request method failure captured: Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 HTTP/1.1 Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgvRgPZd-B_64ft6SWQKWYQrdfYdRK3rH49v70jABcjg2aJorfdpCiePsKlYrulilBUvCm1hQU-ZZR_2zNn-lsf0oJgctRN6MpIzT7LQnot0J45gZ6Q13Fx1smgynpjCQiB_5V-vYmSFkjDF9UFZDCIuhAjfLfpTkGw4uI5ZAbF2E Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:57:18.220200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eacce04e67d14a2f8ae63f5cd115b69c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacce04e67d14a2f8ae63f5cd115b69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: eacce04e67d14a2f8ae63f5cd115b69c Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739420911 Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: d230950f9e984a8b878d7d0f74dda3ce Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739420911-project Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance bdecdfe5-d298-4823-a396-cf390e769f92 could not be found. Jun 23 10:57:18.221620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'bdecdfe5-d298-4823-a396-cf390e769f92'} Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdecdfe5-d298-4823-a396-cf390e769f92 could not be found. Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:57:18.222391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdecdfe5-d298-4823-a396-cf390e769f92 could not be found. Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdecdfe5-d298-4823-a396-cf390e769f92 could not be found. Jun 23 10:57:18.224577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:57:18.225759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] Returning 404 to user: Instance bdecdfe5-d298-4823-a396-cf390e769f92 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:57:18.225759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-481cf957-5615-4860-8f72-21cbd51bff04 tempest-ServerRescueNegativeTestJSON-739420911 tempest-ServerRescueNegativeTestJSON-739420911-project] 10.222.0.39 "GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92" status: 404 len: 111 microversion: 2.1 time: 0.031029 Jun 23 10:57:18.225759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 440/850] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:18 2022] GET /compute/v2.1/servers/bdecdfe5-d298-4823-a396-cf390e769f92 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:57:26.907640 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ebd45339-43c0-4bd2-bc38-77bcd3486e99 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'create', calling method: .version_select at 0x7f8dc9397670>, body: {"keypair": {"name": "tempest-keypair-1198565696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGH5Y5Scq+iK+r0OuUg+oy+PcaFlE1GhbKUA/AfIe57qyFz7CLxIEjBrog46g/DU3tTbBRtsJy8n2MbN9EFklw6+0Ak6fKiUNrO6D6aER5fOv1+35xDFw873wu/BkjUlQ=="}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:26.922191 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-ebd45339-43c0-4bd2-bc38-77bcd3486e99 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Getting quotas for project 737af05e60014fe88e0238e00afb39c6. Resources: {'key_pairs'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:57:26.930058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-ebd45339-43c0-4bd2-bc38-77bcd3486e99 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Getting quotas for user 845a039c954f4384917100206698d015 and project 737af05e60014fe88e0238e00afb39c6. Resources: {'key_pairs'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:57:26.953365 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ebd45339-43c0-4bd2-bc38-77bcd3486e99 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167394 Jun 23 10:57:26.954141 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 411/851] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 10:57:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:28.295866 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1050687399", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5a1131b-deea-4d9e-9f06-b27c7d2c5b49"}], "security_groups": [{"name": "tempest-securitygroup--1667865247"}], "key_name": "tempest-keypair-1198565696", "user_data": "}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:28.303515 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:28.304149 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=65 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:28.409000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.network.neutron [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] validate_networks() for [('f5a1131b-deea-4d9e-9f06-b27c7d2c5b49', None, None, None, None, None)] {{(pid=129460) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:57:28.856755 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Flavor limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:57:28.857645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Image limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:57:28.858120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Flavor pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:57:28.858549 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Image pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:57:28.858958 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:57:28.871158 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:28.871886 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:28.873201 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:28.873912 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:28.891636 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Getting quotas for project 737af05e60014fe88e0238e00afb39c6. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:57:28.896277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Getting quotas for user 845a039c954f4384917100206698d015 and project 737af05e60014fe88e0238e00afb39c6. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:57:28.907351 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Going to run 1 instances... {{(pid=129460) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:57:28.909632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129460) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:57:28.965515 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2bea66bf-20e3-49b4-9773-e6d120a5bebf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.674029 Jun 23 10:57:28.970291 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 441/852] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:57:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:57:28.973211 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:28.979120 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7bf6b89d-affd-4bdd-a8dc-627a420aaed2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:28.979928 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7bf6b89d-affd-4bdd-a8dc-627a420aaed2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:29.049974 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7bf6b89d-affd-4bdd-a8dc-627a420aaed2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:29.059509 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7bf6b89d-affd-4bdd-a8dc-627a420aaed2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1238 microversion: 2.1 time: 0.087019 Jun 23 10:57:29.060500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 412/853] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:28 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:30.078644 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-86413b18-3bfc-4221-b612-0b18189a8581 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:30.079532 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-86413b18-3bfc-4221-b612-0b18189a8581 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:30.092637 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-86413b18-3bfc-4221-b612-0b18189a8581 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:30.097974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-86413b18-3bfc-4221-b612-0b18189a8581 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:30.099456 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-86413b18-3bfc-4221-b612-0b18189a8581 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:30.102636 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-86413b18-3bfc-4221-b612-0b18189a8581 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:30.225734 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-86413b18-3bfc-4221-b612-0b18189a8581 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:30.235641 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-86413b18-3bfc-4221-b612-0b18189a8581 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1308 microversion: 2.1 time: 0.162139 Jun 23 10:57:30.236422 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 442/854] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:30 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:31.255655 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5f5bce3f-fa14-4b1e-abbe-ca17e5d73b0e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:31.256253 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5f5bce3f-fa14-4b1e-abbe-ca17e5d73b0e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:31.259631 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:31.264738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5f5bce3f-fa14-4b1e-abbe-ca17e5d73b0e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:31.265180 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5f5bce3f-fa14-4b1e-abbe-ca17e5d73b0e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:31.265940 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5f5bce3f-fa14-4b1e-abbe-ca17e5d73b0e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:31.266406 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5f5bce3f-fa14-4b1e-abbe-ca17e5d73b0e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:31.399711 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5f5bce3f-fa14-4b1e-abbe-ca17e5d73b0e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:31.411209 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5f5bce3f-fa14-4b1e-abbe-ca17e5d73b0e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1364 microversion: 2.1 time: 0.159568 Jun 23 10:57:31.411836 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 413/855] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:31 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:31.661522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-dead6ad7-ad0d-4ec2-b85a-a3b8e2c53ad0 req-280c4aff-9e90-4574-a66f-e15b7ad24f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a600cb79-ea27-4d68-8e08-1245e12ea0cf", "tag": "b71d26a8-4ffa-4e4d-9499-880bd6b99314"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:31.679813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-dead6ad7-ad0d-4ec2-b85a-a3b8e2c53ad0 req-280c4aff-9e90-4574-a66f-e15b7ad24f58 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:31.680866 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-dead6ad7-ad0d-4ec2-b85a-a3b8e2c53ad0 req-280c4aff-9e90-4574-a66f-e15b7ad24f58 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:31.695138 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-dead6ad7-ad0d-4ec2-b85a-a3b8e2c53ad0 req-280c4aff-9e90-4574-a66f-e15b7ad24f58 service nova] Creating event network-changed:b71d26a8-4ffa-4e4d-9499-880bd6b99314 for instance a600cb79-ea27-4d68-8e08-1245e12ea0cf on hv-cinder-84614 Jun 23 10:57:31.701626 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-dead6ad7-ad0d-4ec2-b85a-a3b8e2c53ad0 req-280c4aff-9e90-4574-a66f-e15b7ad24f58 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047738 Jun 23 10:57:31.703024 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 443/856] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:32.429028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5dedf634-5360-4536-841b-a9f75e308e4e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:32.429685 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5dedf634-5360-4536-841b-a9f75e308e4e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:32.435947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dedf634-5360-4536-841b-a9f75e308e4e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:32.436384 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dedf634-5360-4536-841b-a9f75e308e4e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:32.437133 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dedf634-5360-4536-841b-a9f75e308e4e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:32.437557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dedf634-5360-4536-841b-a9f75e308e4e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:32.572780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5dedf634-5360-4536-841b-a9f75e308e4e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:32.580367 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5dedf634-5360-4536-841b-a9f75e308e4e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1364 microversion: 2.1 time: 0.155958 Jun 23 10:57:32.580910 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 414/857] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:32 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:57:33.606147 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ce5248db-d984-413f-9f81-2f09075efe17 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:33.606854 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ce5248db-d984-413f-9f81-2f09075efe17 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:33.614090 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ce5248db-d984-413f-9f81-2f09075efe17 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:33.614715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ce5248db-d984-413f-9f81-2f09075efe17 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:33.615473 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ce5248db-d984-413f-9f81-2f09075efe17 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:33.615904 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ce5248db-d984-413f-9f81-2f09075efe17 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:33.744088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ce5248db-d984-413f-9f81-2f09075efe17 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:33.751410 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ce5248db-d984-413f-9f81-2f09075efe17 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1364 microversion: 2.1 time: 0.149430 Jun 23 10:57:33.751957 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 444/858] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:33 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:34.768602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c69765d3-4e70-4b23-918c-2b58fdcb2303 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:34.769205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c69765d3-4e70-4b23-918c-2b58fdcb2303 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:34.776173 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c69765d3-4e70-4b23-918c-2b58fdcb2303 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:34.776614 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c69765d3-4e70-4b23-918c-2b58fdcb2303 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:34.777372 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c69765d3-4e70-4b23-918c-2b58fdcb2303 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:34.777798 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c69765d3-4e70-4b23-918c-2b58fdcb2303 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:34.914300 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c69765d3-4e70-4b23-918c-2b58fdcb2303 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:34.922218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c69765d3-4e70-4b23-918c-2b58fdcb2303 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1364 microversion: 2.1 time: 0.157327 Jun 23 10:57:34.922945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 415/859] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:34 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:35.939703 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-abd64c7b-dac3-4d03-b5d9-b0adad83c1e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:35.940307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-abd64c7b-dac3-4d03-b5d9-b0adad83c1e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:35.946787 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abd64c7b-dac3-4d03-b5d9-b0adad83c1e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:35.947439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abd64c7b-dac3-4d03-b5d9-b0adad83c1e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:35.948223 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abd64c7b-dac3-4d03-b5d9-b0adad83c1e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:35.948654 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abd64c7b-dac3-4d03-b5d9-b0adad83c1e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:36.075328 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-abd64c7b-dac3-4d03-b5d9-b0adad83c1e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:36.083256 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-abd64c7b-dac3-4d03-b5d9-b0adad83c1e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1364 microversion: 2.1 time: 0.147436 Jun 23 10:57:36.083875 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 445/860] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:35 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:37.100844 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2fcfb5a3-a8bd-45f4-80cb-29d3e87eeb23 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:37.101457 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2fcfb5a3-a8bd-45f4-80cb-29d3e87eeb23 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:37.108094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2fcfb5a3-a8bd-45f4-80cb-29d3e87eeb23 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:37.108542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2fcfb5a3-a8bd-45f4-80cb-29d3e87eeb23 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:37.109303 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2fcfb5a3-a8bd-45f4-80cb-29d3e87eeb23 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:37.109738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2fcfb5a3-a8bd-45f4-80cb-29d3e87eeb23 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:37.237350 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2fcfb5a3-a8bd-45f4-80cb-29d3e87eeb23 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:37.245220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2fcfb5a3-a8bd-45f4-80cb-29d3e87eeb23 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1364 microversion: 2.1 time: 0.149095 Jun 23 10:57:37.245878 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 416/861] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:37 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:37.381871 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-0a30fc82-155c-4a57-b2c2-33ad8dc50d5d req-2692be20-4015-4c85-9288-b1d2ded5dce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a600cb79-ea27-4d68-8e08-1245e12ea0cf", "name": "network-vif-plugged", "status": "completed", "tag": "b71d26a8-4ffa-4e4d-9499-880bd6b99314"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:37.390603 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-0a30fc82-155c-4a57-b2c2-33ad8dc50d5d req-2692be20-4015-4c85-9288-b1d2ded5dce7 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:37.391114 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-0a30fc82-155c-4a57-b2c2-33ad8dc50d5d req-2692be20-4015-4c85-9288-b1d2ded5dce7 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:37.403221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-0a30fc82-155c-4a57-b2c2-33ad8dc50d5d req-2692be20-4015-4c85-9288-b1d2ded5dce7 service nova] Creating event network-vif-plugged:b71d26a8-4ffa-4e4d-9499-880bd6b99314 for instance a600cb79-ea27-4d68-8e08-1245e12ea0cf on hv-cinder-84614 Jun 23 10:57:37.408334 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-0a30fc82-155c-4a57-b2c2-33ad8dc50d5d req-2692be20-4015-4c85-9288-b1d2ded5dce7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030976 Jun 23 10:57:37.409017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 446/862] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:38.262080 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-74e32197-e84f-4055-ae15-8aff691570c8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:38.262639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-74e32197-e84f-4055-ae15-8aff691570c8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:38.269013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-74e32197-e84f-4055-ae15-8aff691570c8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:38.269454 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-74e32197-e84f-4055-ae15-8aff691570c8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:38.270342 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-74e32197-e84f-4055-ae15-8aff691570c8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:38.270779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-74e32197-e84f-4055-ae15-8aff691570c8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:38.401959 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-74e32197-e84f-4055-ae15-8aff691570c8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:38.409622 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-74e32197-e84f-4055-ae15-8aff691570c8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1364 microversion: 2.1 time: 0.151444 Jun 23 10:57:38.410706 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 417/863] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:38 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:39.424726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:39.425615 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=6 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:39.430222 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f6f369b0-7873-45e1-bde6-e48f88a72996 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:39.431148 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f6f369b0-7873-45e1-bde6-e48f88a72996 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:39.438887 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6f369b0-7873-45e1-bde6-e48f88a72996 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:39.439353 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6f369b0-7873-45e1-bde6-e48f88a72996 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:39.440214 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6f369b0-7873-45e1-bde6-e48f88a72996 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:39.440711 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6f369b0-7873-45e1-bde6-e48f88a72996 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:39.577415 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f6f369b0-7873-45e1-bde6-e48f88a72996 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:39.585534 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f6f369b0-7873-45e1-bde6-e48f88a72996 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1364 microversion: 2.1 time: 0.162205 Jun 23 10:57:39.586098 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 447/864] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:39 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:40.602675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-92e3166a-a151-4e19-9430-5102f2ad397d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:40.603279 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-92e3166a-a151-4e19-9430-5102f2ad397d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:40.605092 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=6 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:40.610705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-92e3166a-a151-4e19-9430-5102f2ad397d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:40.611151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-92e3166a-a151-4e19-9430-5102f2ad397d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:40.611906 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-92e3166a-a151-4e19-9430-5102f2ad397d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:40.612337 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-92e3166a-a151-4e19-9430-5102f2ad397d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:40.745475 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-92e3166a-a151-4e19-9430-5102f2ad397d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:57:40.752883 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-92e3166a-a151-4e19-9430-5102f2ad397d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1551 microversion: 2.1 time: 0.154027 Jun 23 10:57:40.753443 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 418/865] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:57:40 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:57:40.770128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bcd3c5af-7cc1-42b8-8ff4-9f14831cea74 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:40.770641 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bcd3c5af-7cc1-42b8-8ff4-9f14831cea74 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:40.777146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bcd3c5af-7cc1-42b8-8ff4-9f14831cea74 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:40.777597 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bcd3c5af-7cc1-42b8-8ff4-9f14831cea74 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:40.778376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bcd3c5af-7cc1-42b8-8ff4-9f14831cea74 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:40.778814 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bcd3c5af-7cc1-42b8-8ff4-9f14831cea74 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:40.853990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bcd3c5af-7cc1-42b8-8ff4-9f14831cea74 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088194 Jun 23 10:57:40.854620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 448/866] 10.222.0.39 () {58 vars in 1274 bytes} [Thu Jun 23 10:57:40 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:42.003130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-d61d6795-19e2-4ec4-b3af-be874ee2f367 req-e881e6a1-8912-4fc5-82aa-8c61d2eaeea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a600cb79-ea27-4d68-8e08-1245e12ea0cf", "tag": "b71d26a8-4ffa-4e4d-9499-880bd6b99314"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:42.012006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-d61d6795-19e2-4ec4-b3af-be874ee2f367 req-e881e6a1-8912-4fc5-82aa-8c61d2eaeea1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:42.012446 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-d61d6795-19e2-4ec4-b3af-be874ee2f367 req-e881e6a1-8912-4fc5-82aa-8c61d2eaeea1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:42.023951 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-d61d6795-19e2-4ec4-b3af-be874ee2f367 req-e881e6a1-8912-4fc5-82aa-8c61d2eaeea1 service nova] Creating event network-changed:b71d26a8-4ffa-4e4d-9499-880bd6b99314 for instance a600cb79-ea27-4d68-8e08-1245e12ea0cf on hv-cinder-84614 Jun 23 10:57:42.028931 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-d61d6795-19e2-4ec4-b3af-be874ee2f367 req-e881e6a1-8912-4fc5-82aa-8c61d2eaeea1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029397 Jun 23 10:57:42.029877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 419/867] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:55.499187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:55.499937 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=34 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:55.504689 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2f88a8c1-f251-42ae-8dfd-d3caa4b59fa5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:57:55.505192 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2f88a8c1-f251-42ae-8dfd-d3caa4b59fa5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:55.513210 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f88a8c1-f251-42ae-8dfd-d3caa4b59fa5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:55.513656 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f88a8c1-f251-42ae-8dfd-d3caa4b59fa5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:55.514441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f88a8c1-f251-42ae-8dfd-d3caa4b59fa5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:55.514869 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f88a8c1-f251-42ae-8dfd-d3caa4b59fa5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:55.538258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2f88a8c1-f251-42ae-8dfd-d3caa4b59fa5 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/ips" status: 200 len: 150 microversion: 2.1 time: 0.040398 Jun 23 10:57:55.538856 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 449/868] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 10:57:55 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:57:56.850597 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=13 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:56.851352 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=38 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:56.856149 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-cef8a144-42d6-4ee4-9718-ff02ab645865 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c100ded-c5a9-4cca-918c-5c21c5d8d31c"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:57:56.857267 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-cef8a144-42d6-4ee4-9718-ff02ab645865 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:57:56.864675 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cef8a144-42d6-4ee4-9718-ff02ab645865 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:56.865113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cef8a144-42d6-4ee4-9718-ff02ab645865 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:56.865896 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cef8a144-42d6-4ee4-9718-ff02ab645865 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:57:56.866355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cef8a144-42d6-4ee4-9718-ff02ab645865 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:57:57.102885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-cef8a144-42d6-4ee4-9718-ff02ab645865 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253575 Jun 23 10:57:57.103934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 420/869] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 10:57:56 2022] POST /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:58:04.595983 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c100ded-c5a9-4cca-918c-5c21c5d8d31c"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:04.597090 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:04.603632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:04.604077 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:04.604832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:04.605264 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:04.683897 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Invalid volume: volume 4c100ded-c5a9-4cca-918c-5c21c5d8d31c is already attached to instances: 988e9d74-e535-4569-9f46-7970232b6723 Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: POST /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments HTTP/1.1 Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 74 Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 10:58:04.685926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {"volumeAttachment": {"volumeId": "4c100ded-c5a9-4cca-918c-5c21c5d8d31c"}} Jun 23 10:58:04.687536 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Invalid volume: volume 4c100ded-c5a9-4cca-918c-5c21c5d8d31c is already attached to instances: 988e9d74-e535-4569-9f46-7970232b6723 Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'server_id': '988e9d74-e535-4569-9f46-7970232b6723', 'body': {'volumeAttachment': {'volumeId': '4c100ded-c5a9-4cca-918c-5c21c5d8d31c'}}} Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4c100ded-c5a9-4cca-918c-5c21c5d8d31c is already attached to instances: 988e9d74-e535-4569-9f46-7970232b6723 Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:58:04.688367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4c100ded-c5a9-4cca-918c-5c21c5d8d31c is already attached to instances: 988e9d74-e535-4569-9f46-7970232b6723 Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:58:04.689612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:58:04.690889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:58:04.690889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:58:04.690889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:58:04.690889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4c100ded-c5a9-4cca-918c-5c21c5d8d31c is already attached to instances: 988e9d74-e535-4569-9f46-7970232b6723 Jun 23 10:58:04.690889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 10:58:04.690889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 400 to user: Invalid volume: volume 4c100ded-c5a9-4cca-918c-5c21c5d8d31c is already attached to instances: 988e9d74-e535-4569-9f46-7970232b6723 {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:58:04.690889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4ab9a6fe-f2e8-4516-8aca-ee932b1e80da tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095569 Jun 23 10:58:04.690889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 450/870] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 10:58:04 2022] POST /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 10:58:04.748159 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-45ef2811-ca48-4f6b-9fe3-b3bbbf3819e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:04.748739 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-45ef2811-ca48-4f6b-9fe3-b3bbbf3819e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:04.755909 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-45ef2811-ca48-4f6b-9fe3-b3bbbf3819e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:04.756354 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-45ef2811-ca48-4f6b-9fe3-b3bbbf3819e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:04.757111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-45ef2811-ca48-4f6b-9fe3-b3bbbf3819e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:04.757544 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-45ef2811-ca48-4f6b-9fe3-b3bbbf3819e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:04.879543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-45ef2811-ca48-4f6b-9fe3-b3bbbf3819e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lazy-loading 'services' on Instance uuid 988e9d74-e535-4569-9f46-7970232b6723 {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:58:04.993901 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-45ef2811-ca48-4f6b-9fe3-b3bbbf3819e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments/4c100ded-c5a9-4cca-918c-5c21c5d8d31c" status: 202 len: 0 microversion: 2.1 time: 0.249892 Jun 23 10:58:04.994702 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 421/871] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 10:58:04 2022] DELETE /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments/4c100ded-c5a9-4cca-918c-5c21c5d8d31c => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:58:05.003047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e174e35e-e4b5-48c0-90dc-fd7bd59a6486 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:05.004029 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e174e35e-e4b5-48c0-90dc-fd7bd59a6486 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:05.011433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e174e35e-e4b5-48c0-90dc-fd7bd59a6486 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:05.011910 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e174e35e-e4b5-48c0-90dc-fd7bd59a6486 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:05.012708 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e174e35e-e4b5-48c0-90dc-fd7bd59a6486 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:05.013289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e174e35e-e4b5-48c0-90dc-fd7bd59a6486 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:05.044601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e174e35e-e4b5-48c0-90dc-fd7bd59a6486 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 Jun 23 10:58:05.045149 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 451/872] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:58:04 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:58:06.057397 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-abe32e1d-7093-466c-929d-d4e0da922723 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:06.058400 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-abe32e1d-7093-466c-929d-d4e0da922723 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:06.065061 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-abe32e1d-7093-466c-929d-d4e0da922723 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:06.065506 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-abe32e1d-7093-466c-929d-d4e0da922723 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:06.066266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-abe32e1d-7093-466c-929d-d4e0da922723 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:06.066839 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-abe32e1d-7093-466c-929d-d4e0da922723 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:06.098965 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-abe32e1d-7093-466c-929d-d4e0da922723 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045937 Jun 23 10:58:06.099511 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 422/873] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 10:58:06 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 10:58:06.161001 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-89cfa9cb-5682-44a6-a5e1-6a920a126ba2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:06.161558 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-89cfa9cb-5682-44a6-a5e1-6a920a126ba2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:06.168008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-89cfa9cb-5682-44a6-a5e1-6a920a126ba2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:06.168449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-89cfa9cb-5682-44a6-a5e1-6a920a126ba2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:06.169201 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-89cfa9cb-5682-44a6-a5e1-6a920a126ba2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:06.169633 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-89cfa9cb-5682-44a6-a5e1-6a920a126ba2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:06.194910 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-89cfa9cb-5682-44a6-a5e1-6a920a126ba2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 10:58:06.268201 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-89cfa9cb-5682-44a6-a5e1-6a920a126ba2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 204 len: 0 microversion: 2.1 time: 0.110710 Jun 23 10:58:06.268860 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 452/874] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 10:58:06 2022] DELETE /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:58:06.277368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e39c7ebd-8262-4c18-aaa0-3e15bb4408ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:06.277978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e39c7ebd-8262-4c18-aaa0-3e15bb4408ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:06.283988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e39c7ebd-8262-4c18-aaa0-3e15bb4408ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:06.284434 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e39c7ebd-8262-4c18-aaa0-3e15bb4408ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:06.285229 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e39c7ebd-8262-4c18-aaa0-3e15bb4408ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:06.285746 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e39c7ebd-8262-4c18-aaa0-3e15bb4408ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:06.414457 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e39c7ebd-8262-4c18-aaa0-3e15bb4408ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:06.421945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e39c7ebd-8262-4c18-aaa0-3e15bb4408ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1682 microversion: 2.1 time: 0.148458 Jun 23 10:58:06.422532 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 423/875] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:06 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:07.176661 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3b2eb7a9-cdf7-45bf-90c0-7fe9c30ab129 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:07.177260 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3b2eb7a9-cdf7-45bf-90c0-7fe9c30ab129 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:07.183596 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3b2eb7a9-cdf7-45bf-90c0-7fe9c30ab129 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:07.184032 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3b2eb7a9-cdf7-45bf-90c0-7fe9c30ab129 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:07.184783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3b2eb7a9-cdf7-45bf-90c0-7fe9c30ab129 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:07.185207 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3b2eb7a9-cdf7-45bf-90c0-7fe9c30ab129 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:07.208531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3b2eb7a9-cdf7-45bf-90c0-7fe9c30ab129 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/ips" status: 200 len: 151 microversion: 2.20 time: 0.036687 Jun 23 10:58:07.209078 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 453/876] 10.222.0.39 () {60 vars in 1288 bytes} [Thu Jun 23 10:58:07 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:58:07.439617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-067de2ca-fdf0-4595-b406-73261ba43354 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:07.440726 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-067de2ca-fdf0-4595-b406-73261ba43354 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:07.447522 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-067de2ca-fdf0-4595-b406-73261ba43354 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:07.447971 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-067de2ca-fdf0-4595-b406-73261ba43354 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:07.448727 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-067de2ca-fdf0-4595-b406-73261ba43354 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:07.449323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-067de2ca-fdf0-4595-b406-73261ba43354 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:07.585885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-067de2ca-fdf0-4595-b406-73261ba43354 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:07.593293 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-067de2ca-fdf0-4595-b406-73261ba43354 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1682 microversion: 2.1 time: 0.157447 Jun 23 10:58:07.593846 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 424/877] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:07 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:08.610414 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c0b8f6a6-5c4e-48db-9603-fed42e1eb98f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:08.611050 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c0b8f6a6-5c4e-48db-9603-fed42e1eb98f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:08.618071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c0b8f6a6-5c4e-48db-9603-fed42e1eb98f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:08.618557 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c0b8f6a6-5c4e-48db-9603-fed42e1eb98f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:08.619331 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c0b8f6a6-5c4e-48db-9603-fed42e1eb98f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:08.619796 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c0b8f6a6-5c4e-48db-9603-fed42e1eb98f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:08.763158 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c0b8f6a6-5c4e-48db-9603-fed42e1eb98f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:08.771528 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c0b8f6a6-5c4e-48db-9603-fed42e1eb98f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1682 microversion: 2.1 time: 0.164999 Jun 23 10:58:08.772182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 454/878] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:08 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:09.125019 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-22c662f1-c13b-4b7b-8973-9876cab80f4b req-0f56629a-62a1-45fc-bcea-193de653d07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988e9d74-e535-4569-9f46-7970232b6723", "name": "network-vif-deleted", "tag": "9a8602f0-56bb-47e7-93fe-d02998644df6"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:09.143607 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-22c662f1-c13b-4b7b-8973-9876cab80f4b req-0f56629a-62a1-45fc-bcea-193de653d07d service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:09.144048 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-22c662f1-c13b-4b7b-8973-9876cab80f4b req-0f56629a-62a1-45fc-bcea-193de653d07d service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:09.156089 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-22c662f1-c13b-4b7b-8973-9876cab80f4b req-0f56629a-62a1-45fc-bcea-193de653d07d service nova] Creating event network-vif-deleted:9a8602f0-56bb-47e7-93fe-d02998644df6 for instance 988e9d74-e535-4569-9f46-7970232b6723 on hv-cinder-84614 Jun 23 10:58:09.161431 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-22c662f1-c13b-4b7b-8973-9876cab80f4b req-0f56629a-62a1-45fc-bcea-193de653d07d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040006 Jun 23 10:58:09.162014 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 425/879] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:58:09.482677 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-532a8d48-1247-4641-92ea-a5eadd48fdc5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:09.483139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-532a8d48-1247-4641-92ea-a5eadd48fdc5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:09.490194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-532a8d48-1247-4641-92ea-a5eadd48fdc5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:09.490675 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-532a8d48-1247-4641-92ea-a5eadd48fdc5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:09.491459 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-532a8d48-1247-4641-92ea-a5eadd48fdc5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:09.491895 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-532a8d48-1247-4641-92ea-a5eadd48fdc5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:09.515567 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-532a8d48-1247-4641-92ea-a5eadd48fdc5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lazy-loading 'flavor' on Instance uuid 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:58:09.790215 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:09.791166 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:09.803014 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:09.804165 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:09.805324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:09.805769 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:09.825286 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-532a8d48-1247-4641-92ea-a5eadd48fdc5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/action" status: 202 len: 0 microversion: 2.20 time: 0.346143 Jun 23 10:58:09.828070 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 455/880] 10.222.0.39 () {62 vars in 1318 bytes} [Thu Jun 23 10:58:09 2022] POST /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:58:09.841345 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:09.842401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:09.850706 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:09.851291 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:09.852237 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:09.852674 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:09.856738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:09.857177 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:09.857927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lazy-loading 'fault' on Instance uuid 988e9d74-e535-4569-9f46-7970232b6723 {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 10:58:09.902083 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:09.911224 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-947e727e-240f-426a-8861-4a765c7853c3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 200 len: 1331 microversion: 2.1 time: 0.125124 Jun 23 10:58:09.912120 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 426/881] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:09 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:58:10.008647 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:10.016987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:10.018527 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:10.019928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-76bbf1d8-203e-45e6-8182-a479c57e22c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.188074 Jun 23 10:58:10.020508 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 456/882] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:09 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:10.928714 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:10.929328 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:10.935799 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:10.936244 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:10.937002 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:10.937434 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:10.951118 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 HTTP/1.1 Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 10:58:10.952988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 10:58:10.954551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '988e9d74-e535-4569-9f46-7970232b6723'} Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:58:10.955542 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 10:58:10.956871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 10:58:10.958066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:58:10.958066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-390c42fb-e82c-45fa-991b-b7d852b1665f tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 404 len: 111 microversion: 2.1 time: 0.030060 Jun 23 10:58:10.958066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 427/883] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:10 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 10:58:10.963141 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1752f4ca-9833-4f45-a46b-d3c9a617d0e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '.version_select at 0x7f8dc907bca0>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:10.979708 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1752f4ca-9833-4f45-a46b-d3c9a617d0e2 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1197397116" status: 202 len: 0 microversion: 2.1 time: 0.020240 Jun 23 10:58:10.980247 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 457/884] 10.222.0.39 () {58 vars in 1220 bytes} [Thu Jun 23 10:58:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1197397116 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 10:58:11.039435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:11.040073 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:11.045944 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:11.046490 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:11.047256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:11.047685 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:11.211047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:11.219367 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:11.220879 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:11.222026 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6c4e5f43-b700-414f-ba7c-e9f0d59d319a tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.187739 Jun 23 10:58:11.222689 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 428/885] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:11 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:11.641973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-445cdfc2-681f-45f5-ad1f-042b109be9ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: .version_select at 0x7f8dc90d5ee0>, body: {"keypair": {"name": "tempest-keypair-635017521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYTAWhzvctCulBdotIJDMJwLXFqSwwj9y9m0QGKIJ3bB8CXggGO89S4yVeXH1Ip9s9J9Rq1m5yBIXS9H+Z8hmObNrEyrzr6scFMjXiYajtsjlIzxj2o6bXpsyADJ2cnOQ=="}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:11.656722 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-445cdfc2-681f-45f5-ad1f-042b109be9ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for project 2123ff10502044b9aea48720440c2291. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:58:11.660902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-445cdfc2-681f-45f5-ad1f-042b109be9ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for user eb8df5670686403480cdfd32ac408945 and project 2123ff10502044b9aea48720440c2291. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:58:11.682070 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-445cdfc2-681f-45f5-ad1f-042b109be9ce tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044013 Jun 23 10:58:11.682682 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 458/886] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 10:58:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:58:12.241054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:12.241719 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:12.248227 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:12.248673 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:12.249439 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:12.249868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:12.386940 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:12.396965 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:12.398646 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:12.400596 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-18186963-4b12-4e7f-8aaa-a9b22893d4df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.163235 Jun 23 10:58:12.402130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 429/887] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:12 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:12.969113 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1334462122", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66f9eed7-b9a6-4658-b62c-bb41bfa6807b"}], "security_groups": [{"name": "tempest-securitygroup--976333399"}], "key_name": "tempest-keypair-635017521", "user_data": "}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:13.065897 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.network.neutron [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] validate_networks() for [('66f9eed7-b9a6-4658-b62c-bb41bfa6807b', None, None, None, None, None)] {{(pid=129460) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:58:13.421502 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:13.422137 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:13.425615 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Flavor limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:58:13.426914 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Image limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:58:13.427464 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Flavor pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:58:13.427932 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Image pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:58:13.428431 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:58:13.429245 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:13.429685 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:13.430470 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:13.430897 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:13.437979 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:13.438526 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:13.439374 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:13.439885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:13.456804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for project 2123ff10502044b9aea48720440c2291. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:58:13.460845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Getting quotas for user eb8df5670686403480cdfd32ac408945 and project 2123ff10502044b9aea48720440c2291. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:58:13.471893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Going to run 1 instances... {{(pid=129460) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:58:13.474943 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129460) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:58:13.523896 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3f0a360c-9f66-40ff-8d4b-593ffdfa96af tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.559449 Jun 23 10:58:13.529490 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 459/888] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:58:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:58:13.539448 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5fcb5952-ef6c-4d80-8ef1-879f9307b5d3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:13.539448 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5fcb5952-ef6c-4d80-8ef1-879f9307b5d3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:13.562243 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:13.571803 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:13.573424 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:13.574692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-930c859c-2895-449f-9f30-298836e8bcbd tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.157441 Jun 23 10:58:13.575327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 430/889] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:13 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:13.602311 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5fcb5952-ef6c-4d80-8ef1-879f9307b5d3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:13.609425 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5fcb5952-ef6c-4d80-8ef1-879f9307b5d3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1241 microversion: 2.1 time: 0.078673 Jun 23 10:58:13.609987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 460/890] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:13 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:58:14.594682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:14.595895 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:14.605684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:14.606139 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:14.607036 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:14.607376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:14.626817 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8003ac7b-df58-484e-b4ca-8e94d4d41552 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:14.628363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8003ac7b-df58-484e-b4ca-8e94d4d41552 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:14.636933 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8003ac7b-df58-484e-b4ca-8e94d4d41552 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:14.637379 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8003ac7b-df58-484e-b4ca-8e94d4d41552 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:14.638145 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8003ac7b-df58-484e-b4ca-8e94d4d41552 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:14.638690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8003ac7b-df58-484e-b4ca-8e94d4d41552 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:14.740840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8003ac7b-df58-484e-b4ca-8e94d4d41552 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:14.748696 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8003ac7b-df58-484e-b4ca-8e94d4d41552 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1311 microversion: 2.1 time: 0.126397 Jun 23 10:58:14.756990 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 461/891] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:14 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:14.789235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:14.797055 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:14.798517 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:14.799726 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1bfaab06-5c22-446b-8a45-b65167a6555b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.208909 Jun 23 10:58:14.800262 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 431/892] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:14 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:15.768539 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-152e3d0f-6016-4b51-be0d-2592cc184e3b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:15.769258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-152e3d0f-6016-4b51-be0d-2592cc184e3b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:15.777624 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-152e3d0f-6016-4b51-be0d-2592cc184e3b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:15.777848 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-152e3d0f-6016-4b51-be0d-2592cc184e3b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:15.778591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-152e3d0f-6016-4b51-be0d-2592cc184e3b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:15.779027 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-152e3d0f-6016-4b51-be0d-2592cc184e3b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:15.817981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:15.819629 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:15.830328 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:15.831073 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:15.832661 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:15.833273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:15.991640 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-152e3d0f-6016-4b51-be0d-2592cc184e3b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:16.002627 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-152e3d0f-6016-4b51-be0d-2592cc184e3b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1366 microversion: 2.1 time: 0.239228 Jun 23 10:58:16.003476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 462/893] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:15 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:16.017668 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-7f418abf-3b4c-46f2-b57f-6876488e0eda req-2f71f64f-73e1-4fca-b804-55a689e9453e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d5d2ac-766a-47cf-8a08-8512d6ff439b", "tag": "23e8732a-8d7d-4ecb-b429-785063a38ac1"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:16.029832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-7f418abf-3b4c-46f2-b57f-6876488e0eda req-2f71f64f-73e1-4fca-b804-55a689e9453e service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:16.030657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-7f418abf-3b4c-46f2-b57f-6876488e0eda req-2f71f64f-73e1-4fca-b804-55a689e9453e service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:16.037804 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:16.047015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-7f418abf-3b4c-46f2-b57f-6876488e0eda req-2f71f64f-73e1-4fca-b804-55a689e9453e service nova] Creating event network-changed:23e8732a-8d7d-4ecb-b429-785063a38ac1 for instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b on hv-cinder-84614 Jun 23 10:58:16.049577 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:16.051125 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:16.053077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2c26ac94-d9d7-4779-8e47-9e6373c38cd9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.239311 Jun 23 10:58:16.053637 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-7f418abf-3b4c-46f2-b57f-6876488e0eda req-2f71f64f-73e1-4fca-b804-55a689e9453e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048667 Jun 23 10:58:16.054381 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 463/894] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:58:16.056364 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 432/895] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:15 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:58:17.020691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-98b94a48-2716-4f8b-8281-46c50b371055 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:17.021996 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-98b94a48-2716-4f8b-8281-46c50b371055 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:17.028311 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-98b94a48-2716-4f8b-8281-46c50b371055 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:17.028757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-98b94a48-2716-4f8b-8281-46c50b371055 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:17.029506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-98b94a48-2716-4f8b-8281-46c50b371055 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:17.029940 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-98b94a48-2716-4f8b-8281-46c50b371055 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:17.073450 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:17.074062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:17.080827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:17.081277 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:17.082039 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:17.082510 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:17.214386 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-98b94a48-2716-4f8b-8281-46c50b371055 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:17.222305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-98b94a48-2716-4f8b-8281-46c50b371055 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1366 microversion: 2.1 time: 0.206237 Jun 23 10:58:17.223144 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 464/896] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:17 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:17.242104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:17.249876 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:17.251385 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:17.252524 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9bc5cdd3-674c-47e9-b333-74c30d553d18 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.182956 Jun 23 10:58:17.253070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 433/897] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:17 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:58:18.240809 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ba211ab3-d6bc-44e2-8152-c23051ae3480 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:18.241397 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ba211ab3-d6bc-44e2-8152-c23051ae3480 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:18.247788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ba211ab3-d6bc-44e2-8152-c23051ae3480 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:18.248227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ba211ab3-d6bc-44e2-8152-c23051ae3480 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:18.248974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ba211ab3-d6bc-44e2-8152-c23051ae3480 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:18.249402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ba211ab3-d6bc-44e2-8152-c23051ae3480 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:18.271351 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:18.272518 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:18.279308 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:18.279771 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:18.280525 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:18.280966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:18.448751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ba211ab3-d6bc-44e2-8152-c23051ae3480 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:18.455792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:18.456630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ba211ab3-d6bc-44e2-8152-c23051ae3480 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1366 microversion: 2.1 time: 0.220660 Jun 23 10:58:18.457194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 465/898] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:18 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:18.464012 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:18.465520 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:18.466697 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c2e12587-5efe-48e8-8bbb-0e8e83e8987d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.199175 Jun 23 10:58:18.467236 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 434/899] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:18 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:58:19.472910 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9c044098-5258-4050-a43c-bb521a9cb549 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:19.473514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9c044098-5258-4050-a43c-bb521a9cb549 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:19.481264 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9c044098-5258-4050-a43c-bb521a9cb549 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:19.481712 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9c044098-5258-4050-a43c-bb521a9cb549 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:19.482510 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9c044098-5258-4050-a43c-bb521a9cb549 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:19.482946 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9c044098-5258-4050-a43c-bb521a9cb549 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:19.484655 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:19.485960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:19.493706 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:19.494007 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:19.495800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:19.496258 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:19.526760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:19.693464 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9c044098-5258-4050-a43c-bb521a9cb549 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:19.697167 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:19.701938 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:19.702192 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9c044098-5258-4050-a43c-bb521a9cb549 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1366 microversion: 2.1 time: 0.232844 Jun 23 10:58:19.702797 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 466/900] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:19 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:19.711011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:19.712526 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:19.713684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ece067f1-ad5b-49f5-a6ca-2debe50c996f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.232882 Jun 23 10:58:19.714224 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 435/901] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:19 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:58:20.720259 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-221310cf-771b-4b10-b8b3-2f8978317f1d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:20.720797 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-221310cf-771b-4b10-b8b3-2f8978317f1d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:20.727551 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-221310cf-771b-4b10-b8b3-2f8978317f1d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:20.727997 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-221310cf-771b-4b10-b8b3-2f8978317f1d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:20.728843 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-221310cf-771b-4b10-b8b3-2f8978317f1d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:20.729278 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-221310cf-771b-4b10-b8b3-2f8978317f1d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:20.732600 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:20.733782 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:20.740605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:20.741947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:20.743013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:20.743441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:20.869100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-221310cf-771b-4b10-b8b3-2f8978317f1d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:20.877303 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-221310cf-771b-4b10-b8b3-2f8978317f1d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1366 microversion: 2.1 time: 0.161179 Jun 23 10:58:20.877889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 467/902] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:20 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:21.021294 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:21.029963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:21.031480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:21.032625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1fdc812a-5799-4ba2-bc74-33c549ebb280 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.304351 Jun 23 10:58:21.033170 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 436/903] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:20 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:21.589882 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-7cfb21e3-0039-4eeb-b225-0ad4eeda98f3 req-ac49215e-55e7-41c4-818d-853122827eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d5d2ac-766a-47cf-8a08-8512d6ff439b", "name": "network-vif-plugged", "status": "completed", "tag": "23e8732a-8d7d-4ecb-b429-785063a38ac1"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:21.598450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-7cfb21e3-0039-4eeb-b225-0ad4eeda98f3 req-ac49215e-55e7-41c4-818d-853122827eab service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:21.599126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-7cfb21e3-0039-4eeb-b225-0ad4eeda98f3 req-ac49215e-55e7-41c4-818d-853122827eab service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:21.612025 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-7cfb21e3-0039-4eeb-b225-0ad4eeda98f3 req-ac49215e-55e7-41c4-818d-853122827eab service nova] Creating event network-vif-plugged:23e8732a-8d7d-4ecb-b429-785063a38ac1 for instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b on hv-cinder-84614 Jun 23 10:58:21.618264 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-7cfb21e3-0039-4eeb-b225-0ad4eeda98f3 req-ac49215e-55e7-41c4-818d-853122827eab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033123 Jun 23 10:58:21.618925 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 468/904] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:58:21.894111 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b9742914-7f04-49a3-a389-c926574aab69 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:21.894684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b9742914-7f04-49a3-a389-c926574aab69 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:21.901841 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9742914-7f04-49a3-a389-c926574aab69 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:21.902288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9742914-7f04-49a3-a389-c926574aab69 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:21.903081 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9742914-7f04-49a3-a389-c926574aab69 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:21.903516 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b9742914-7f04-49a3-a389-c926574aab69 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:22.033695 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b9742914-7f04-49a3-a389-c926574aab69 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:22.041740 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b9742914-7f04-49a3-a389-c926574aab69 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1366 microversion: 2.1 time: 0.151496 Jun 23 10:58:22.042285 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 437/905] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:21 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:22.051508 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:22.052232 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:22.059506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:22.059951 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:22.060713 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:22.061144 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:22.195157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:22.203188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:22.204664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:22.205794 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-29efc99b-b485-4218-bfa4-4761b17f8383 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.158492 Jun 23 10:58:22.206371 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 469/906] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:22 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:23.059187 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-07455d17-b207-46cb-8ffd-1b4a7fc71a14 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:23.059791 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-07455d17-b207-46cb-8ffd-1b4a7fc71a14 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:23.066342 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-07455d17-b207-46cb-8ffd-1b4a7fc71a14 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:23.066790 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-07455d17-b207-46cb-8ffd-1b4a7fc71a14 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:23.067544 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-07455d17-b207-46cb-8ffd-1b4a7fc71a14 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:23.067970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-07455d17-b207-46cb-8ffd-1b4a7fc71a14 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:23.198509 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-07455d17-b207-46cb-8ffd-1b4a7fc71a14 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:23.206152 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-07455d17-b207-46cb-8ffd-1b4a7fc71a14 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1366 microversion: 2.1 time: 0.150699 Jun 23 10:58:23.206681 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 438/907] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:23 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:58:23.223367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:23.223992 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:23.231207 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:23.231716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:23.232706 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:23.233088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:23.365117 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:23.373685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:23.375194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:23.376332 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c99e2fd7-5bc2-47e7-acfd-2f1ec41a8847 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.156779 Jun 23 10:58:23.376874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 470/908] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:23 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:24.223465 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-41c417f5-a2db-4496-aa55-70f4f5efa04c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:24.224078 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-41c417f5-a2db-4496-aa55-70f4f5efa04c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:24.231125 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-41c417f5-a2db-4496-aa55-70f4f5efa04c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:24.231838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-41c417f5-a2db-4496-aa55-70f4f5efa04c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:24.233117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-41c417f5-a2db-4496-aa55-70f4f5efa04c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:24.233732 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-41c417f5-a2db-4496-aa55-70f4f5efa04c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:24.361477 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-41c417f5-a2db-4496-aa55-70f4f5efa04c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:24.369506 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-41c417f5-a2db-4496-aa55-70f4f5efa04c tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1555 microversion: 2.1 time: 0.149879 Jun 23 10:58:24.370055 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 439/909] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:58:24 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:58:24.385436 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ea4d77b4-d7cc-40b4-841a-a9befeb22d66 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:24.385942 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ea4d77b4-d7cc-40b4-841a-a9befeb22d66 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:24.387859 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:24.388675 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=12 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:24.394898 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:24.395500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:24.396221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ea4d77b4-d7cc-40b4-841a-a9befeb22d66 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:24.396676 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ea4d77b4-d7cc-40b4-841a-a9befeb22d66 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:24.397939 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ea4d77b4-d7cc-40b4-841a-a9befeb22d66 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:24.398546 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ea4d77b4-d7cc-40b4-841a-a9befeb22d66 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:24.402093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:24.402563 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:24.403328 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:24.403750 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:24.508789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ea4d77b4-d7cc-40b4-841a-a9befeb22d66 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127100 Jun 23 10:58:24.509378 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 471/910] 10.222.0.39 () {58 vars in 1274 bytes} [Thu Jun 23 10:58:24 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:58:24.655564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:24.664161 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:24.665653 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:24.666957 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2cbb4602-f579-47c6-b72f-bfb61284b59f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.275853 Jun 23 10:58:24.667531 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 440/911] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:24 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:58:25.456526 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-bef4c47c-719b-4b6f-bb75-d223f5b3bb82 req-5843f0f0-1688-42f9-be54-6c4f2f3b5e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d5d2ac-766a-47cf-8a08-8512d6ff439b", "tag": "23e8732a-8d7d-4ecb-b429-785063a38ac1"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:25.466177 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-bef4c47c-719b-4b6f-bb75-d223f5b3bb82 req-5843f0f0-1688-42f9-be54-6c4f2f3b5e4b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:25.466730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-bef4c47c-719b-4b6f-bb75-d223f5b3bb82 req-5843f0f0-1688-42f9-be54-6c4f2f3b5e4b service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:25.479383 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-bef4c47c-719b-4b6f-bb75-d223f5b3bb82 req-5843f0f0-1688-42f9-be54-6c4f2f3b5e4b service nova] Creating event network-changed:23e8732a-8d7d-4ecb-b429-785063a38ac1 for instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b on hv-cinder-84614 Jun 23 10:58:25.484719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-bef4c47c-719b-4b6f-bb75-d223f5b3bb82 req-5843f0f0-1688-42f9-be54-6c4f2f3b5e4b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032549 Jun 23 10:58:25.485982 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 472/912] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:58:25.685545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:25.686847 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:25.693449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:25.693901 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:25.694802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:25.695330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:25.848442 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:25.857415 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:25.859079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:25.860257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8d29ec28-35ef-42b1-aa9e-0866b5a30baf tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.178611 Jun 23 10:58:25.861780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 441/913] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:25 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:26.879305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:26.879909 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:26.881872 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:26.887630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:26.888076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:26.888842 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:26.889292 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:27.019318 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:27.027655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:27.029164 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:27.030307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9e7bf0ea-84af-454b-9bee-d00deb72fc10 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1744 microversion: 2.20 time: 0.155915 Jun 23 10:58:27.030878 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 473/914] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:26 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:28.049400 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:28.049976 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:28.052242 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=47 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:28.058664 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:28.059115 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:28.059877 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:28.060309 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:28.189351 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:28.198349 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:28.199837 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:28.200979 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4998d3d3-11dc-452d-b574-cd50813c619e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1744 microversion: 2.20 time: 0.155769 Jun 23 10:58:28.201518 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 442/915] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:28 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:29.219410 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:29.220013 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:29.227230 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:29.227672 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:29.228422 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:29.228850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:29.363908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:29.372553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:29.374034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:29.375196 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-64e91f80-7b34-4dfb-b410-2a9ab0fbc141 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1744 microversion: 2.20 time: 0.160292 Jun 23 10:58:29.375738 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 474/916] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:29 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:29.637153 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-0c953481-bd85-498c-851f-d21a9b77e2eb req-2e0ce3c2-1661-45b1-a0ec-39abe346a163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf2c8ff-3746-44d7-9eeb-96dc1c860432", "name": "network-vif-plugged", "status": "completed", "tag": "42635af4-43f0-435c-bf3e-bc1aabbcf87a"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:29.645891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-0c953481-bd85-498c-851f-d21a9b77e2eb req-2e0ce3c2-1661-45b1-a0ec-39abe346a163 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:29.646337 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-0c953481-bd85-498c-851f-d21a9b77e2eb req-2e0ce3c2-1661-45b1-a0ec-39abe346a163 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:29.659262 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-0c953481-bd85-498c-851f-d21a9b77e2eb req-2e0ce3c2-1661-45b1-a0ec-39abe346a163 service nova] Creating event network-vif-plugged:42635af4-43f0-435c-bf3e-bc1aabbcf87a for instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 on hv-cinder-84614 Jun 23 10:58:29.665787 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-0c953481-bd85-498c-851f-d21a9b77e2eb req-2e0ce3c2-1661-45b1-a0ec-39abe346a163 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032215 Jun 23 10:58:29.666650 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 443/917] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:58:30.393418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:30.394020 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:30.401322 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:30.401766 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:30.402551 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:30.402977 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:30.533693 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:30.541821 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:30.543342 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:30.544498 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-dfe80be3-d5f3-45c6-8c6c-599ddee637da tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1744 microversion: 2.20 time: 0.154963 Jun 23 10:58:30.545047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 475/918] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:30 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:31.563786 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:31.564470 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:31.570906 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:31.571343 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:31.572120 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:31.572549 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:31.703795 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:31.712137 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:31.713623 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:31.714822 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7980771b-d2b5-4aa9-b760-39a6afb4ad59 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1744 microversion: 2.20 time: 0.155746 Jun 23 10:58:31.715359 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 444/919] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:31 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:32.732995 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:32.733591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:32.740325 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:32.740768 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:32.741531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:32.741967 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:32.875114 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:32.883992 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:32.885529 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:32.886741 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1bee63c8-fc32-4fd7-97c8-1607887bb63b tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1744 microversion: 2.20 time: 0.157701 Jun 23 10:58:32.887289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 476/920] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:32 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:33.904956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:33.905728 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:33.912613 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:33.914459 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:33.915362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:33.916044 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:34.078682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:34.089731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:34.091588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:34.093045 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-079aff11-e9b0-480d-ac63-a5d9cd0d5feb tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1739 microversion: 2.20 time: 0.192026 Jun 23 10:58:34.093907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 445/921] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:33 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:35.112429 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:35.113266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:35.120872 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:35.122305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:35.123466 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:35.123906 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:35.293862 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:35.308938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:35.310499 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:35.311808 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-79761665-d93c-401e-919c-f25000e303b9 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1739 microversion: 2.20 time: 0.203356 Jun 23 10:58:35.312818 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 477/922] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:35 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:36.332284 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:36.333529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:36.341282 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:36.342558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:36.343973 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:36.344746 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:36.501472 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:36.511266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:36.513218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:36.515046 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-85f80339-c7be-41f5-92db-d00373850de6 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1739 microversion: 2.20 time: 0.187720 Jun 23 10:58:36.517057 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 446/923] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:36 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:37.536649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:37.537260 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:37.544802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:37.545246 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:37.546038 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:37.547334 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:38.138439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:38.147214 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:38.149978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:38.151268 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a428936b-6865-417e-b538-e123329726ef tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1739 microversion: 2.20 time: 0.619754 Jun 23 10:58:38.152114 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 478/924] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:37 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1739 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:58:39.170942 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:39.173107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:39.181706 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:39.182255 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:39.183121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:39.183797 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:39.368368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:39.379058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:39.380941 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:39.383857 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f9dc405a-925b-472a-9667-1512c9675185 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1739 microversion: 2.20 time: 0.217366 Jun 23 10:58:39.385551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 447/925] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:39 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:40.403535 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:40.404349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:40.411381 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:40.411825 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:40.412822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:40.413788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:40.573526 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:40.582014 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:40.583626 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:40.585621 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1a7ad2ee-ffdd-459b-bc6f-585cc724fc7d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1739 microversion: 2.20 time: 0.185464 Jun 23 10:58:40.586094 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 479/926] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:40 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:41.604477 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:41.605156 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:41.612172 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:41.612628 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:41.613448 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:41.614007 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:41.783313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:41.792494 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:41.793978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:41.795190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-bf05a53e-2041-4f51-88c1-05941744c646 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1739 microversion: 2.20 time: 0.195216 Jun 23 10:58:41.795924 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 448/927] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:41 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:42.813839 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:42.814472 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:42.822016 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:42.823478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:42.824593 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:42.825022 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:42.955464 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:42.963294 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:42.964766 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:42.965931 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-69e1545b-a026-4941-a544-32c2a0d27326 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1739 microversion: 2.20 time: 0.155932 Jun 23 10:58:42.966612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 480/928] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:42 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:43.984827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:43.985738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:43.992605 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:43.993050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:43.994065 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:43.994537 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:44.126418 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:44.135527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:44.137049 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:44.138401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ab0a9be4-a368-43c5-9441-24a18952320f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1721 microversion: 2.20 time: 0.157533 Jun 23 10:58:44.139022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 449/929] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:43 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:45.157514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:45.158168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:45.165720 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:45.166158 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:45.166932 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:45.167368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:45.295290 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:45.303395 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:45.305083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:45.306219 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-db44a7be-0128-4179-ad94-1c78f7b98008 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1721 microversion: 2.20 time: 0.152610 Jun 23 10:58:45.306784 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 481/930] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:45 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:46.325246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:46.325829 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:46.332532 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:46.332976 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:46.333731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:46.334163 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:46.466000 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:46.473793 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:46.475290 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:46.476458 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d2c793dd-7053-487b-a7f8-12423accef4e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1664 microversion: 2.20 time: 0.155133 Jun 23 10:58:46.476998 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 450/931] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:46 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:58:46.493709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-10fe9309-97dd-4bdd-a5b9-326f1525befa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48b323ae-2e89-4635-abdf-624e3ff0516b"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:46.494782 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-10fe9309-97dd-4bdd-a5b9-326f1525befa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:46.501083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10fe9309-97dd-4bdd-a5b9-326f1525befa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:46.501520 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10fe9309-97dd-4bdd-a5b9-326f1525befa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:46.502269 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10fe9309-97dd-4bdd-a5b9-326f1525befa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:46.502728 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-10fe9309-97dd-4bdd-a5b9-326f1525befa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:46.757776 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:46.765780 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-10fe9309-97dd-4bdd-a5b9-326f1525befa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.276075 Jun 23 10:58:46.766388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 482/932] 10.222.0.39 () {62 vars in 1363 bytes} [Thu Jun 23 10:58:46 2022] POST /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/os-volume_attachments => generated 188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:58:46.878436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-254f28b4-268c-4d5b-9727-c30d137530c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:46.878932 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-254f28b4-268c-4d5b-9727-c30d137530c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:46.884987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-254f28b4-268c-4d5b-9727-c30d137530c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:46.885431 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-254f28b4-268c-4d5b-9727-c30d137530c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:46.886182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-254f28b4-268c-4d5b-9727-c30d137530c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:46.886646 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-254f28b4-268c-4d5b-9727-c30d137530c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:46.983148 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:47.123210 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-254f28b4-268c-4d5b-9727-c30d137530c5 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/os-volume_attachments/48b323ae-2e89-4635-abdf-624e3ff0516b" status: 202 len: 0 microversion: 2.20 time: 0.248561 Jun 23 10:58:47.123713 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 451/933] 10.222.0.39 () {60 vars in 1456 bytes} [Thu Jun 23 10:58:46 2022] DELETE /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/os-volume_attachments/48b323ae-2e89-4635-abdf-624e3ff0516b => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:58:47.179850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7d77e52b-0e26-4cbc-959a-14b37caa1775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:47.180414 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7d77e52b-0e26-4cbc-959a-14b37caa1775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:47.187061 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7d77e52b-0e26-4cbc-959a-14b37caa1775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:47.187513 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7d77e52b-0e26-4cbc-959a-14b37caa1775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:47.188274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7d77e52b-0e26-4cbc-959a-14b37caa1775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:47.188717 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7d77e52b-0e26-4cbc-959a-14b37caa1775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:47.279805 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7d77e52b-0e26-4cbc-959a-14b37caa1775 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "POST /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/action" status: 202 len: 0 microversion: 2.20 time: 0.104501 Jun 23 10:58:47.280392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 483/934] 10.222.0.39 () {62 vars in 1318 bytes} [Thu Jun 23 10:58:47 2022] POST /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 10:58:47.288868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:47.289509 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:47.296039 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:47.296482 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:47.297234 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:47.297659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:47.433721 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:47.441684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:47.443217 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:47.444384 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-de5d28a1-4ba6-4a9f-8be7-86a0bba057ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1672 microversion: 2.20 time: 0.159905 Jun 23 10:58:47.444934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 452/935] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:47 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:47.675476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-ed7981d3-bed2-4152-a853-d85f97f8be6a req-e17d572d-4002-4efc-9b6c-c0cb76c8b4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf2c8ff-3746-44d7-9eeb-96dc1c860432", "name": "network-vif-unplugged", "status": "completed", "tag": "42635af4-43f0-435c-bf3e-bc1aabbcf87a"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:58:47.689600 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-ed7981d3-bed2-4152-a853-d85f97f8be6a req-e17d572d-4002-4efc-9b6c-c0cb76c8b4d0 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:47.690050 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-ed7981d3-bed2-4152-a853-d85f97f8be6a req-e17d572d-4002-4efc-9b6c-c0cb76c8b4d0 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:47.701721 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.compute.server_external_events [req-ed7981d3-bed2-4152-a853-d85f97f8be6a req-e17d572d-4002-4efc-9b6c-c0cb76c8b4d0 service nova] Unable to find a host for instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432. Dropping event network-vif-unplugged {{(pid=129460) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 10:58:47.703167 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-ed7981d3-bed2-4152-a853-d85f97f8be6a req-e17d572d-4002-4efc-9b6c-c0cb76c8b4d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032630 Jun 23 10:58:47.703742 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 484/936] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 23 10:58:48.464093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:48.464678 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:48.471127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:48.471575 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:48.472334 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:48.472763 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:48.612696 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:48.620782 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:48.622260 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:48.623460 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0970c9b6-538e-4740-b170-e18a2adfb034 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.164427 Jun 23 10:58:48.624010 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 453/937] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:48 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:49.648761 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:49.657766 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:49.666656 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:49.667289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:49.668299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:49.668804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:49.805402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:49.816182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:49.816182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:49.817156 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2b56f5ac-5ca7-4a18-99d6-5a8bec6b930d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.177641 Jun 23 10:58:49.817877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 485/938] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:49 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:58:50.834737 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:50.835342 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:50.842421 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:50.842868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:50.843624 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:50.844055 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:50.985639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:50.994603 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:50.996105 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:50.997277 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-04a38eb4-7836-4609-b328-29d2d5539758 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.166586 Jun 23 10:58:50.997832 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 454/939] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:50 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:52.015393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:52.016013 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:52.022471 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:52.022909 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:52.023655 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:52.024083 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:52.176425 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:52.185460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:52.187001 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:52.188164 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ce8d06af-b1e4-482e-a98c-ed3241f8b7af tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.176696 Jun 23 10:58:52.188924 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 486/940] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:52 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 10:58:53.206854 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:53.207437 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:53.215638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:53.215638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:53.216447 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:53.216879 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:53.358822 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:53.366978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:53.368608 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:53.369800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-01834d8a-7ced-49b0-a346-7b340decffc1 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.166927 Jun 23 10:58:53.370558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 455/941] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:53 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:54.389735 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:54.390433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:54.396961 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:54.397425 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:54.398172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:54.398640 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:54.541115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:54.549786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:54.551292 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:54.552433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bd171969-38a4-4220-9d09-3edbbad68651 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.167699 Jun 23 10:58:54.552979 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 487/942] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:54 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:55.571577 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:55.572184 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:55.579106 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:55.579549 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:55.580328 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:55.580757 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:55.717761 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:55.725975 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:55.727498 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:55.728657 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-af7aae58-7eb1-4956-a8fd-21a064e5e707 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.161040 Jun 23 10:58:55.729208 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 456/943] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:55 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:56.748783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:56.749607 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:56.757232 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:56.757791 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:56.758608 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:56.759038 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:56.904849 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:56.913357 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:56.914892 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:56.916077 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1c5f47f7-73f3-4707-967d-c39dd918f513 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.173356 Jun 23 10:58:56.926570 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 488/944] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:56 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:57.934661 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:57.935267 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:57.941812 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:57.942248 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:57.943038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:57.943463 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:58.081664 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:58.090017 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:58.091815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:58.093003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-311c5e33-adbe-4a7d-b92d-f3a9f37bed65 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.162938 Jun 23 10:58:58.093560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 457/945] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:57 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:58:59.111447 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:58:59.112030 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:58:59.114085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=34 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:59.119470 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:59.119911 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:59.120660 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:58:59.121681 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:58:59.253680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:59.262674 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:59.264189 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:58:59.265346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-206f947e-c4cb-45a9-be6e-2fd49bdb2daa tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.157849 Jun 23 10:58:59.265908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 489/946] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:58:59 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:00.284490 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:00.285094 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:00.287397 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=32 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:00.293107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:00.293939 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:00.294730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:00.295169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:00.425843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:00.434754 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:00.436256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:00.437407 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-845bcf73-39b7-4a6d-a3fd-0a62b5efb7e2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.157094 Jun 23 10:59:00.437939 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 458/947] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:00 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:01.455178 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:01.455783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:01.462274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:01.462754 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:01.463514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:01.463949 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:01.594609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:01.602394 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:01.603877 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:01.605020 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a96ff1a0-4b86-49a3-bcb6-6dcc183df514 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.153965 Jun 23 10:59:01.606096 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 490/948] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:01 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:02.623739 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:02.624346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:02.630932 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:02.631375 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:02.632125 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:02.632579 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:02.764089 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:02.771900 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:02.773381 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:02.774557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-87346194-c43b-4c64-9f53-f1b657c8c9ca tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.155009 Jun 23 10:59:02.775097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 459/949] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:02 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:03.812672 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:03.813427 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:03.828515 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:03.829489 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:03.830385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:03.830827 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:03.969966 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:03.977827 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:03.979338 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:03.980487 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2d09d2cc-46fb-4cb6-9f57-b596609f158c tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.189297 Jun 23 10:59:03.981034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 491/950] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:03 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:05.000293 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:05.000293 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:05.007047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:05.007487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:05.008244 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:05.008676 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:05.136088 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:05.144122 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:05.145598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:05.146801 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-574908f5-1a8c-45b6-b62e-6d8e0c9da7df tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.151596 Jun 23 10:59:05.147356 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 460/951] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:04 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:06.165071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:06.165694 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:06.173167 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:06.173694 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:06.174469 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:06.174940 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:06.308296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:06.317252 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:06.318759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:06.319911 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-14b7b049-2fdb-40f8-8a20-b5ad62d42654 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.158844 Jun 23 10:59:06.320464 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 492/952] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:06 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:07.339688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:07.340275 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:07.347376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:07.347817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:07.348574 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:07.349011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:07.479988 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:07.488800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:07.490297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:07.491477 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-cbd49dca-3ccc-469c-af15-60e5ab2ede28 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.156190 Jun 23 10:59:07.492030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 461/953] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:07 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:07.831760 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-487524f0-cd93-4b7c-a1d8-4d53097047c1 req-bebbbde2-bdc0-4a74-9dca-51de946498f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf2c8ff-3746-44d7-9eeb-96dc1c860432", "name": "network-vif-plugged", "status": "completed", "tag": "42635af4-43f0-435c-bf3e-bc1aabbcf87a"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:59:07.841365 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-487524f0-cd93-4b7c-a1d8-4d53097047c1 req-bebbbde2-bdc0-4a74-9dca-51de946498f6 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:07.842218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-487524f0-cd93-4b7c-a1d8-4d53097047c1 req-bebbbde2-bdc0-4a74-9dca-51de946498f6 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:07.854140 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-487524f0-cd93-4b7c-a1d8-4d53097047c1 req-bebbbde2-bdc0-4a74-9dca-51de946498f6 service nova] Creating event network-vif-plugged:42635af4-43f0-435c-bf3e-bc1aabbcf87a for instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 on hv-cinder-84614 Jun 23 10:59:07.859881 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-487524f0-cd93-4b7c-a1d8-4d53097047c1 req-bebbbde2-bdc0-4a74-9dca-51de946498f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032201 Jun 23 10:59:07.860628 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 493/954] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:59:08.509374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:08.509967 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:08.516426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:08.516868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:08.517644 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:08.518099 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:08.648311 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:08.656389 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:08.657856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:08.659026 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6bc4c246-d5e7-4781-8438-f846a2a66132 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.153499 Jun 23 10:59:08.659577 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 462/955] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:08 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:09.629901 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2706c07d-49b0-42a9-a47b-ea9a15b99c87 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:09.630495 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2706c07d-49b0-42a9-a47b-ea9a15b99c87 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:09.637100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2706c07d-49b0-42a9-a47b-ea9a15b99c87 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:09.638612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2706c07d-49b0-42a9-a47b-ea9a15b99c87 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:09.639220 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2706c07d-49b0-42a9-a47b-ea9a15b99c87 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:09.639651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2706c07d-49b0-42a9-a47b-ea9a15b99c87 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:09.661929 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2706c07d-49b0-42a9-a47b-ea9a15b99c87 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/ips" status: 200 len: 146 microversion: 2.1 time: 0.036244 Jun 23 10:59:09.662500 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 494/956] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 10:59:09 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:59:09.676700 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:09.677292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:09.683732 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:09.684166 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:09.685679 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:09.686108 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:09.813762 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:09.821557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:09.823071 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:09.824213 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1203e4e4-1574-42db-a111-893266e2f57e tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1730 microversion: 2.20 time: 0.151326 Jun 23 10:59:09.824787 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 463/957] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:09 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:10.843742 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:10.844340 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:10.850741 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:10.851179 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:10.851923 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:10.852349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:10.986062 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:10.993899 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:10.995408 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:10.996550 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-31fb80bc-f285-4fb8-8e0c-74a175080f63 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1717 microversion: 2.20 time: 0.156986 Jun 23 10:59:10.997321 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 495/958] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 10:59:10 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:59:11.709260 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e05e15b2-f162-4fdf-883c-9e2fa0cff817 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b820327f-05ad-4dd2-bce7-3ce47bacd765"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:59:11.710429 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e05e15b2-f162-4fdf-883c-9e2fa0cff817 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:11.718025 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e05e15b2-f162-4fdf-883c-9e2fa0cff817 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:11.718520 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e05e15b2-f162-4fdf-883c-9e2fa0cff817 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:11.719276 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e05e15b2-f162-4fdf-883c-9e2fa0cff817 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:11.719703 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e05e15b2-f162-4fdf-883c-9e2fa0cff817 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:11.954906 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e05e15b2-f162-4fdf-883c-9e2fa0cff817 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249075 Jun 23 10:59:11.955505 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 464/959] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 10:59:11 2022] POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:59:19.443526 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c38981fc-cb92-4175-be10-e72fe9a81fdb tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:59:19.450776 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c38981fc-cb92-4175-be10-e72fe9a81fdb tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:19.451236 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c38981fc-cb92-4175-be10-e72fe9a81fdb tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:19.477893 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:19.517210 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c38981fc-cb92-4175-be10-e72fe9a81fdb tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Going to try to stop instance {{(pid=129460) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 10:59:19.560516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c38981fc-cb92-4175-be10-e72fe9a81fdb tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/action" status: 202 len: 0 microversion: 2.1 time: 0.119832 Jun 23 10:59:19.561172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 496/960] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:59:19 2022] POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 10:59:19.569678 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b6c8ed27-63f1-4802-afcb-4d995c554fbf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:19.570393 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b6c8ed27-63f1-4802-afcb-4d995c554fbf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:19.578514 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b6c8ed27-63f1-4802-afcb-4d995c554fbf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:19.578960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b6c8ed27-63f1-4802-afcb-4d995c554fbf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:19.579724 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b6c8ed27-63f1-4802-afcb-4d995c554fbf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:19.580158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b6c8ed27-63f1-4802-afcb-4d995c554fbf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:19.584361 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:INSERT=2,nova_cell1:SELECT=88 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:19.710919 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b6c8ed27-63f1-4802-afcb-4d995c554fbf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:19.719740 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b6c8ed27-63f1-4802-afcb-4d995c554fbf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.153858 Jun 23 10:59:19.720357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 465/961] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:19 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:20.739440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-50d6e1fc-ff1a-42df-9130-5ccc9d488d84 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:20.740046 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-50d6e1fc-ff1a-42df-9130-5ccc9d488d84 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:20.746678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-50d6e1fc-ff1a-42df-9130-5ccc9d488d84 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:20.747130 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-50d6e1fc-ff1a-42df-9130-5ccc9d488d84 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:20.748069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-50d6e1fc-ff1a-42df-9130-5ccc9d488d84 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:20.748502 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-50d6e1fc-ff1a-42df-9130-5ccc9d488d84 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:20.877331 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-50d6e1fc-ff1a-42df-9130-5ccc9d488d84 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:20.885322 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-50d6e1fc-ff1a-42df-9130-5ccc9d488d84 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.150176 Jun 23 10:59:20.885889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 497/962] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:20 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:21.903705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f507d7aa-522a-4260-bb98-a1ce99fd1f05 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:21.904309 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f507d7aa-522a-4260-bb98-a1ce99fd1f05 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:21.910766 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f507d7aa-522a-4260-bb98-a1ce99fd1f05 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:21.911207 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f507d7aa-522a-4260-bb98-a1ce99fd1f05 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:21.911952 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f507d7aa-522a-4260-bb98-a1ce99fd1f05 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:21.912374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f507d7aa-522a-4260-bb98-a1ce99fd1f05 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:22.045425 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f507d7aa-522a-4260-bb98-a1ce99fd1f05 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:22.053663 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f507d7aa-522a-4260-bb98-a1ce99fd1f05 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.154020 Jun 23 10:59:22.054375 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 466/963] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:21 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:23.070970 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b404892d-6ad7-4069-b663-dbd58ca7c018 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:23.071572 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b404892d-6ad7-4069-b663-dbd58ca7c018 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:23.078390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b404892d-6ad7-4069-b663-dbd58ca7c018 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:23.078835 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b404892d-6ad7-4069-b663-dbd58ca7c018 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:23.079588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b404892d-6ad7-4069-b663-dbd58ca7c018 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:23.080017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b404892d-6ad7-4069-b663-dbd58ca7c018 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:23.207998 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b404892d-6ad7-4069-b663-dbd58ca7c018 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:23.216475 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b404892d-6ad7-4069-b663-dbd58ca7c018 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.148734 Jun 23 10:59:23.217229 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 498/964] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:23 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:23.733752 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-340863269", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1984337626", "security_groups": [{"name": "tempest-secgroup-smoke-1207352602"}], "block_device_mapping_v2": [{"uuid": "78c17edd-02c5-48cf-b3f0-36888b4bef28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d50fe3b-1b55-47cc-8ab0-a390036040cd"}]}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:59:23.842959 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] validate_networks() for [('7d50fe3b-1b55-47cc-8ab0-a390036040cd', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 10:59:24.209422 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 10:59:24.209869 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 10:59:24.210362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 10:59:24.210795 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 10:59:24.211222 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 10:59:24.221105 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:24.221543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:24.222344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:24.222781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:24.233823 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bf18439d-27be-40fe-8dbd-44b6aece97f2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:24.234643 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bf18439d-27be-40fe-8dbd-44b6aece97f2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:24.241136 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf18439d-27be-40fe-8dbd-44b6aece97f2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:24.241288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Getting quotas for project 79dbb107721b4406b5c3e2f5081034fd. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 10:59:24.241590 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf18439d-27be-40fe-8dbd-44b6aece97f2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:24.242383 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf18439d-27be-40fe-8dbd-44b6aece97f2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:24.242822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf18439d-27be-40fe-8dbd-44b6aece97f2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:24.245478 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Getting quotas for user 10ae039c34c442f880c51aaf9024db8d and project 79dbb107721b4406b5c3e2f5081034fd. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 10:59:24.303744 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 10:59:24.305818 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78c17edd-02c5-48cf-b3f0-36888b4bef28',volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 10:59:24.380978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bf18439d-27be-40fe-8dbd-44b6aece97f2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:24.389537 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bf18439d-27be-40fe-8dbd-44b6aece97f2 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.159715 Jun 23 10:59:24.390102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 499/965] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:24 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:59:24.439891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7c468fae-eedf-4c3f-9a0f-dd663c3b6c54 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710028 Jun 23 10:59:24.440524 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 467/966] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 10:59:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 10:59:24.451502 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7259e606-9c10-447b-bcb8-a0cde6361198 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:24.452187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7259e606-9c10-447b-bcb8-a0cde6361198 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:24.516901 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7259e606-9c10-447b-bcb8-a0cde6361198 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:24.524223 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7259e606-9c10-447b-bcb8-a0cde6361198 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1094 microversion: 2.1 time: 0.077292 Jun 23 10:59:24.524795 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 500/967] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:24 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:25.407905 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6dcf9caa-d75e-4c05-bb89-f2f9c6f4474f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:25.408514 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6dcf9caa-d75e-4c05-bb89-f2f9c6f4474f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:25.414659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6dcf9caa-d75e-4c05-bb89-f2f9c6f4474f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:25.415205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6dcf9caa-d75e-4c05-bb89-f2f9c6f4474f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:25.416162 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6dcf9caa-d75e-4c05-bb89-f2f9c6f4474f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:25.416595 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6dcf9caa-d75e-4c05-bb89-f2f9c6f4474f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:25.545891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-58eb6dcf-da09-47df-9e52-05d5c079a7f5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:25.547105 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-58eb6dcf-da09-47df-9e52-05d5c079a7f5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:25.563192 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-58eb6dcf-da09-47df-9e52-05d5c079a7f5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:25.564133 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-58eb6dcf-da09-47df-9e52-05d5c079a7f5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:25.570824 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-58eb6dcf-da09-47df-9e52-05d5c079a7f5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:25.571282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-58eb6dcf-da09-47df-9e52-05d5c079a7f5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:25.585413 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-6dcf9caa-d75e-4c05-bb89-f2f9c6f4474f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:25.595142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6dcf9caa-d75e-4c05-bb89-f2f9c6f4474f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.191976 Jun 23 10:59:25.595717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 468/968] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:25 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:25.643981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-58eb6dcf-da09-47df-9e52-05d5c079a7f5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:25.657012 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-58eb6dcf-da09-47df-9e52-05d5c079a7f5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1210 microversion: 2.1 time: 0.116662 Jun 23 10:59:25.657993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 501/969] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:25 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:26.614584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a2066720-8e33-4ce7-87fe-8dd0dd4707c3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:26.615228 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a2066720-8e33-4ce7-87fe-8dd0dd4707c3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:26.622529 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2066720-8e33-4ce7-87fe-8dd0dd4707c3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:26.623249 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2066720-8e33-4ce7-87fe-8dd0dd4707c3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:26.625426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2066720-8e33-4ce7-87fe-8dd0dd4707c3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:26.626172 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2066720-8e33-4ce7-87fe-8dd0dd4707c3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:26.685480 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-453d2940-666d-4796-a9e1-66b876fd0da1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:26.686360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-453d2940-666d-4796-a9e1-66b876fd0da1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:26.692833 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-453d2940-666d-4796-a9e1-66b876fd0da1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:26.693501 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-453d2940-666d-4796-a9e1-66b876fd0da1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:26.694503 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-453d2940-666d-4796-a9e1-66b876fd0da1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:26.695126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-453d2940-666d-4796-a9e1-66b876fd0da1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:26.851682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-a2066720-8e33-4ce7-87fe-8dd0dd4707c3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:26.861558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a2066720-8e33-4ce7-87fe-8dd0dd4707c3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.251517 Jun 23 10:59:26.866338 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 469/970] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:26 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:26.900457 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-453d2940-666d-4796-a9e1-66b876fd0da1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:26.910639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-1329aae1-c965-434d-bf47-3e8dcd9e9760 req-289ecdc2-d1c7-44d8-bd96-1b7430c5e93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc479a7-01a4-4542-ba20-fb9940274d47", "tag": "d0280365-24f6-4acb-be5d-6150915fc998"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:59:26.920935 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-453d2940-666d-4796-a9e1-66b876fd0da1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.239856 Jun 23 10:59:26.921707 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 502/971] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:26 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:26.942868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-1329aae1-c965-434d-bf47-3e8dcd9e9760 req-289ecdc2-d1c7-44d8-bd96-1b7430c5e93a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:26.943578 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-1329aae1-c965-434d-bf47-3e8dcd9e9760 req-289ecdc2-d1c7-44d8-bd96-1b7430c5e93a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:26.959568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-1329aae1-c965-434d-bf47-3e8dcd9e9760 req-289ecdc2-d1c7-44d8-bd96-1b7430c5e93a service nova] Creating event network-changed:d0280365-24f6-4acb-be5d-6150915fc998 for instance 6bc479a7-01a4-4542-ba20-fb9940274d47 on hv-cinder-84614 Jun 23 10:59:26.966229 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-1329aae1-c965-434d-bf47-3e8dcd9e9760 req-289ecdc2-d1c7-44d8-bd96-1b7430c5e93a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063984 Jun 23 10:59:26.967305 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 470/972] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:59:27.879369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e4cf6224-dc28-4eb2-b35c-423f5682e2fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:27.879980 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e4cf6224-dc28-4eb2-b35c-423f5682e2fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:27.886025 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e4cf6224-dc28-4eb2-b35c-423f5682e2fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:27.886508 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e4cf6224-dc28-4eb2-b35c-423f5682e2fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:27.887267 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e4cf6224-dc28-4eb2-b35c-423f5682e2fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:27.887707 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e4cf6224-dc28-4eb2-b35c-423f5682e2fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:27.940382 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-88079810-1756-4651-a324-80488da9767b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:27.941074 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-88079810-1756-4651-a324-80488da9767b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:27.947494 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-88079810-1756-4651-a324-80488da9767b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:27.947959 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-88079810-1756-4651-a324-80488da9767b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:27.948712 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-88079810-1756-4651-a324-80488da9767b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:27.949141 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-88079810-1756-4651-a324-80488da9767b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:28.055846 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-e4cf6224-dc28-4eb2-b35c-423f5682e2fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:28.064488 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e4cf6224-dc28-4eb2-b35c-423f5682e2fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.189157 Jun 23 10:59:28.065059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 503/973] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:27 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:28.104645 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-88079810-1756-4651-a324-80488da9767b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:28.112983 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-88079810-1756-4651-a324-80488da9767b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.177246 Jun 23 10:59:28.113535 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 471/974] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:27 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:59:29.082063 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-477b95b8-6e6d-4447-84d5-d8a59dc8e033 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:29.082702 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-477b95b8-6e6d-4447-84d5-d8a59dc8e033 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:29.089264 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-477b95b8-6e6d-4447-84d5-d8a59dc8e033 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:29.089714 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-477b95b8-6e6d-4447-84d5-d8a59dc8e033 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:29.091121 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-477b95b8-6e6d-4447-84d5-d8a59dc8e033 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:29.091615 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-477b95b8-6e6d-4447-84d5-d8a59dc8e033 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:29.130401 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-37ce2682-4aac-4f4a-9944-4262ef8781fc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:29.131003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-37ce2682-4aac-4f4a-9944-4262ef8781fc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:29.138385 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-37ce2682-4aac-4f4a-9944-4262ef8781fc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:29.138749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-37ce2682-4aac-4f4a-9944-4262ef8781fc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:29.139525 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-37ce2682-4aac-4f4a-9944-4262ef8781fc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:29.139960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-37ce2682-4aac-4f4a-9944-4262ef8781fc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:29.284218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-477b95b8-6e6d-4447-84d5-d8a59dc8e033 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:29.292501 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-477b95b8-6e6d-4447-84d5-d8a59dc8e033 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.214241 Jun 23 10:59:29.293069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 504/975] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:29 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:29.335589 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-37ce2682-4aac-4f4a-9944-4262ef8781fc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:29.343673 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-37ce2682-4aac-4f4a-9944-4262ef8781fc tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.217200 Jun 23 10:59:29.344251 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 472/976] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:29 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:59:30.311204 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-473353e4-c399-4268-b619-02677ee1829a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:30.311821 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-473353e4-c399-4268-b619-02677ee1829a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:30.315070 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=34 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:30.320582 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-473353e4-c399-4268-b619-02677ee1829a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:30.321092 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-473353e4-c399-4268-b619-02677ee1829a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:30.322844 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-473353e4-c399-4268-b619-02677ee1829a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:30.323376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-473353e4-c399-4268-b619-02677ee1829a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:30.361544 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-13097097-ee3b-488f-a9c0-d70644b3a744 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:30.364076 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-13097097-ee3b-488f-a9c0-d70644b3a744 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:30.366662 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:30.373379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-13097097-ee3b-488f-a9c0-d70644b3a744 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:30.374404 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-13097097-ee3b-488f-a9c0-d70644b3a744 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:30.375638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-13097097-ee3b-488f-a9c0-d70644b3a744 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:30.376082 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-13097097-ee3b-488f-a9c0-d70644b3a744 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:30.549047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-473353e4-c399-4268-b619-02677ee1829a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:30.558173 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-473353e4-c399-4268-b619-02677ee1829a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.250818 Jun 23 10:59:30.559002 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 505/977] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:30 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:30.581054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-13097097-ee3b-488f-a9c0-d70644b3a744 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:30.588699 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-13097097-ee3b-488f-a9c0-d70644b3a744 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.231013 Jun 23 10:59:30.589266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 473/978] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:30 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:31.576661 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9519393c-163b-435d-ad41-217fd07f781f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:31.577256 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9519393c-163b-435d-ad41-217fd07f781f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:31.584018 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9519393c-163b-435d-ad41-217fd07f781f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:31.584460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9519393c-163b-435d-ad41-217fd07f781f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:31.585212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9519393c-163b-435d-ad41-217fd07f781f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:31.585637 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9519393c-163b-435d-ad41-217fd07f781f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:31.605582 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-614cae9f-650c-4bb8-922a-a87bf32086bb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:31.606966 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-614cae9f-650c-4bb8-922a-a87bf32086bb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:31.613439 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-614cae9f-650c-4bb8-922a-a87bf32086bb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:31.613884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-614cae9f-650c-4bb8-922a-a87bf32086bb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:31.614681 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-614cae9f-650c-4bb8-922a-a87bf32086bb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:31.615118 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-614cae9f-650c-4bb8-922a-a87bf32086bb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:31.765335 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9519393c-163b-435d-ad41-217fd07f781f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:31.773366 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9519393c-163b-435d-ad41-217fd07f781f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.201149 Jun 23 10:59:31.773931 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 506/979] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:31 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:31.794296 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-614cae9f-650c-4bb8-922a-a87bf32086bb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:31.801609 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-614cae9f-650c-4bb8-922a-a87bf32086bb tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.199845 Jun 23 10:59:31.802155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 474/980] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:31 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:59:32.790345 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2cf2bb28-0945-4350-a81c-bf2a7ff34cb8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:32.790881 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2cf2bb28-0945-4350-a81c-bf2a7ff34cb8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:32.797687 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2cf2bb28-0945-4350-a81c-bf2a7ff34cb8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:32.798136 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2cf2bb28-0945-4350-a81c-bf2a7ff34cb8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:32.798974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2cf2bb28-0945-4350-a81c-bf2a7ff34cb8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:32.799470 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2cf2bb28-0945-4350-a81c-bf2a7ff34cb8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:32.818633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-73c6fc3f-1202-4e9a-8363-9e6d696a2e39 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:32.819230 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-73c6fc3f-1202-4e9a-8363-9e6d696a2e39 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:32.826648 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-73c6fc3f-1202-4e9a-8363-9e6d696a2e39 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:32.827092 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-73c6fc3f-1202-4e9a-8363-9e6d696a2e39 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:32.828097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-73c6fc3f-1202-4e9a-8363-9e6d696a2e39 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:32.828522 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-73c6fc3f-1202-4e9a-8363-9e6d696a2e39 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:33.005018 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2cf2bb28-0945-4350-a81c-bf2a7ff34cb8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:33.010848 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-73c6fc3f-1202-4e9a-8363-9e6d696a2e39 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:33.013954 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2cf2bb28-0945-4350-a81c-bf2a7ff34cb8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.227557 Jun 23 10:59:33.014567 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 507/981] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:32 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:33.020104 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-73c6fc3f-1202-4e9a-8363-9e6d696a2e39 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.205167 Jun 23 10:59:33.020677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 475/982] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:32 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:59:34.031592 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1495d314-c097-4d1c-bcb3-e4910b7c1eb3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:34.032273 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1495d314-c097-4d1c-bcb3-e4910b7c1eb3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:34.037316 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-89e4f9aa-115c-487d-b59a-83aa94846a3a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:34.037954 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-89e4f9aa-115c-487d-b59a-83aa94846a3a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:34.039335 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1495d314-c097-4d1c-bcb3-e4910b7c1eb3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:34.039789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1495d314-c097-4d1c-bcb3-e4910b7c1eb3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:34.040599 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1495d314-c097-4d1c-bcb3-e4910b7c1eb3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:34.041029 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1495d314-c097-4d1c-bcb3-e4910b7c1eb3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:34.046412 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-89e4f9aa-115c-487d-b59a-83aa94846a3a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:34.046864 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-89e4f9aa-115c-487d-b59a-83aa94846a3a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:34.047635 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-89e4f9aa-115c-487d-b59a-83aa94846a3a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:34.048066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-89e4f9aa-115c-487d-b59a-83aa94846a3a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:34.228554 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:34.240585 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1495d314-c097-4d1c-bcb3-e4910b7c1eb3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:34.249490 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1495d314-c097-4d1c-bcb3-e4910b7c1eb3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1725 microversion: 2.1 time: 0.221657 Jun 23 10:59:34.250074 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 508/983] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:34 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:34.251398 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-89e4f9aa-115c-487d-b59a-83aa94846a3a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:34.253632 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=6 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:34.261301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-89e4f9aa-115c-487d-b59a-83aa94846a3a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.227741 Jun 23 10:59:34.261961 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 476/984] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:34 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:35.269672 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bf40fbf5-76f4-4f2d-bcba-226a94aa337f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:35.270225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bf40fbf5-76f4-4f2d-bcba-226a94aa337f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:35.272129 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:35.278367 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf40fbf5-76f4-4f2d-bcba-226a94aa337f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:35.278820 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf40fbf5-76f4-4f2d-bcba-226a94aa337f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:35.279342 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5e8f0e75-4e53-402e-8923-3eda231ff4fd tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:35.279837 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf40fbf5-76f4-4f2d-bcba-226a94aa337f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:35.279999 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5e8f0e75-4e53-402e-8923-3eda231ff4fd tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:35.280106 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bf40fbf5-76f4-4f2d-bcba-226a94aa337f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:35.286711 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e8f0e75-4e53-402e-8923-3eda231ff4fd tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:35.287154 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e8f0e75-4e53-402e-8923-3eda231ff4fd tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:35.287901 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e8f0e75-4e53-402e-8923-3eda231ff4fd tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:35.288326 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5e8f0e75-4e53-402e-8923-3eda231ff4fd tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:35.494748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5e8f0e75-4e53-402e-8923-3eda231ff4fd tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:35.498716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bf40fbf5-76f4-4f2d-bcba-226a94aa337f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:35.503357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5e8f0e75-4e53-402e-8923-3eda231ff4fd tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.228299 Jun 23 10:59:35.503936 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 477/985] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:35 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:35.506926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bf40fbf5-76f4-4f2d-bcba-226a94aa337f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1702 microversion: 2.1 time: 0.243251 Jun 23 10:59:35.507487 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 509/986] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:35 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1702 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:35.524017 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-47813d93-691c-48ff-82dc-89528278478d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:59:35.531246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-47813d93-691c-48ff-82dc-89528278478d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:35.532020 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-47813d93-691c-48ff-82dc-89528278478d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:35.594656 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-47813d93-691c-48ff-82dc-89528278478d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Going to try to start instance {{(pid=129461) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 10:59:35.635167 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-47813d93-691c-48ff-82dc-89528278478d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/action" status: 202 len: 0 microversion: 2.1 time: 0.115018 Jun 23 10:59:35.635774 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 478/987] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 10:59:35 2022] POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 10:59:35.647361 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-491a7ebe-e39e-46fe-8f6a-ffbc7a2b650b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:35.648000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-491a7ebe-e39e-46fe-8f6a-ffbc7a2b650b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:35.656803 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-491a7ebe-e39e-46fe-8f6a-ffbc7a2b650b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:35.657322 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-491a7ebe-e39e-46fe-8f6a-ffbc7a2b650b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:35.658226 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-491a7ebe-e39e-46fe-8f6a-ffbc7a2b650b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:35.658851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-491a7ebe-e39e-46fe-8f6a-ffbc7a2b650b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:35.801178 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-491a7ebe-e39e-46fe-8f6a-ffbc7a2b650b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:35.811844 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-491a7ebe-e39e-46fe-8f6a-ffbc7a2b650b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1711 microversion: 2.1 time: 0.167855 Jun 23 10:59:35.812751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 510/988] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:35 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1711 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:36.522022 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f376379d-21ef-40e1-8c88-52f70d820ffe tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:36.522770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f376379d-21ef-40e1-8c88-52f70d820ffe tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:36.529595 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f376379d-21ef-40e1-8c88-52f70d820ffe tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:36.530039 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f376379d-21ef-40e1-8c88-52f70d820ffe tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:36.530862 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f376379d-21ef-40e1-8c88-52f70d820ffe tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:36.531298 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f376379d-21ef-40e1-8c88-52f70d820ffe tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:36.674551 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f376379d-21ef-40e1-8c88-52f70d820ffe tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:36.681967 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f376379d-21ef-40e1-8c88-52f70d820ffe tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.164805 Jun 23 10:59:36.682546 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 479/989] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:36 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:36.829170 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-55561258-7a25-4cab-a7aa-34d3f3f8bae3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:36.829796 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-55561258-7a25-4cab-a7aa-34d3f3f8bae3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:36.836350 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55561258-7a25-4cab-a7aa-34d3f3f8bae3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:36.836799 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55561258-7a25-4cab-a7aa-34d3f3f8bae3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:36.837543 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55561258-7a25-4cab-a7aa-34d3f3f8bae3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:36.837974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-55561258-7a25-4cab-a7aa-34d3f3f8bae3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:36.972516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-55561258-7a25-4cab-a7aa-34d3f3f8bae3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:36.981959 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-55561258-7a25-4cab-a7aa-34d3f3f8bae3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1711 microversion: 2.1 time: 0.157255 Jun 23 10:59:36.982928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 511/990] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:36 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1711 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:37.699832 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-22062280-322d-4138-be26-a3522f69a3db tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:37.700735 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-22062280-322d-4138-be26-a3522f69a3db tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:37.707478 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-22062280-322d-4138-be26-a3522f69a3db tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:37.707920 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-22062280-322d-4138-be26-a3522f69a3db tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:37.708672 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-22062280-322d-4138-be26-a3522f69a3db tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:37.709097 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-22062280-322d-4138-be26-a3522f69a3db tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:37.843484 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-22062280-322d-4138-be26-a3522f69a3db tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:37.850951 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-22062280-322d-4138-be26-a3522f69a3db tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.154960 Jun 23 10:59:37.851507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 480/991] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:37 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:38.000394 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5bd0a363-625b-454c-9883-1dd8a8820308 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:38.001007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-5bd0a363-625b-454c-9883-1dd8a8820308 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:38.008155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5bd0a363-625b-454c-9883-1dd8a8820308 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:38.008627 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5bd0a363-625b-454c-9883-1dd8a8820308 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:38.009494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5bd0a363-625b-454c-9883-1dd8a8820308 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:38.009933 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-5bd0a363-625b-454c-9883-1dd8a8820308 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:38.015433 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-50fba1eb-37d8-4ed5-84dd-546d1f3d00db req-8eeb5b74-e7c3-47ab-96d2-cdd7a0c7e234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc479a7-01a4-4542-ba20-fb9940274d47", "name": "network-vif-plugged", "status": "completed", "tag": "d0280365-24f6-4acb-be5d-6150915fc998"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:59:38.024853 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-50fba1eb-37d8-4ed5-84dd-546d1f3d00db req-8eeb5b74-e7c3-47ab-96d2-cdd7a0c7e234 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:38.025547 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-50fba1eb-37d8-4ed5-84dd-546d1f3d00db req-8eeb5b74-e7c3-47ab-96d2-cdd7a0c7e234 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:38.037252 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-50fba1eb-37d8-4ed5-84dd-546d1f3d00db req-8eeb5b74-e7c3-47ab-96d2-cdd7a0c7e234 service nova] Creating event network-vif-plugged:d0280365-24f6-4acb-be5d-6150915fc998 for instance 6bc479a7-01a4-4542-ba20-fb9940274d47 on hv-cinder-84614 Jun 23 10:59:38.042519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-50fba1eb-37d8-4ed5-84dd-546d1f3d00db req-8eeb5b74-e7c3-47ab-96d2-cdd7a0c7e234 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 Jun 23 10:59:38.043365 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 481/992] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:59:38.149649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-5bd0a363-625b-454c-9883-1dd8a8820308 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:38.151918 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:38.160471 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5bd0a363-625b-454c-9883-1dd8a8820308 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1715 microversion: 2.1 time: 0.164488 Jun 23 10:59:38.161039 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 512/993] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:37 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:38.868794 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-cfb78305-11e2-425d-ad87-643b7e849cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:38.869487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-cfb78305-11e2-425d-ad87-643b7e849cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:38.876310 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cfb78305-11e2-425d-ad87-643b7e849cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:38.876753 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cfb78305-11e2-425d-ad87-643b7e849cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:38.877508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cfb78305-11e2-425d-ad87-643b7e849cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:38.877942 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-cfb78305-11e2-425d-ad87-643b7e849cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:39.008933 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-cfb78305-11e2-425d-ad87-643b7e849cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:39.011219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:39.018246 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-cfb78305-11e2-425d-ad87-643b7e849cb0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.154073 Jun 23 10:59:39.018835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 482/994] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:38 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:40.035035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d81e4cdc-d821-443f-aee5-7448b7cd7878 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:40.035635 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d81e4cdc-d821-443f-aee5-7448b7cd7878 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:40.043977 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d81e4cdc-d821-443f-aee5-7448b7cd7878 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:40.044543 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d81e4cdc-d821-443f-aee5-7448b7cd7878 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:40.045360 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d81e4cdc-d821-443f-aee5-7448b7cd7878 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:40.045786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d81e4cdc-d821-443f-aee5-7448b7cd7878 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:40.177543 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d81e4cdc-d821-443f-aee5-7448b7cd7878 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:40.186084 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d81e4cdc-d821-443f-aee5-7448b7cd7878 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1266 microversion: 2.1 time: 0.154866 Jun 23 10:59:40.186687 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 513/995] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:40 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:41.203411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3bd97a25-b070-4c14-ba07-c24a8644c910 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:41.204044 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3bd97a25-b070-4c14-ba07-c24a8644c910 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:41.211853 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3bd97a25-b070-4c14-ba07-c24a8644c910 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:41.212299 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3bd97a25-b070-4c14-ba07-c24a8644c910 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:41.213056 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3bd97a25-b070-4c14-ba07-c24a8644c910 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:41.213490 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3bd97a25-b070-4c14-ba07-c24a8644c910 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:41.341659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3bd97a25-b070-4c14-ba07-c24a8644c910 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:41.349205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3bd97a25-b070-4c14-ba07-c24a8644c910 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1453 microversion: 2.1 time: 0.150471 Jun 23 10:59:41.349760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 483/996] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:41 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:41.366289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-abfae75d-05ba-4072-96e5-934174fccdda tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:41.366921 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-abfae75d-05ba-4072-96e5-934174fccdda tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 10:59:41.374250 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abfae75d-05ba-4072-96e5-934174fccdda tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:41.374722 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abfae75d-05ba-4072-96e5-934174fccdda tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:41.375503 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abfae75d-05ba-4072-96e5-934174fccdda tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:41.375936 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-abfae75d-05ba-4072-96e5-934174fccdda tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:41.506110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-abfae75d-05ba-4072-96e5-934174fccdda tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 10:59:41.513583 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-abfae75d-05ba-4072-96e5-934174fccdda tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1453 microversion: 2.1 time: 0.151110 Jun 23 10:59:41.514135 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 514/997] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 10:59:41 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:59:43.460797 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-7a384bdc-6456-4895-8d86-f137c736cbca req-8563c6fb-f99d-431c-b151-f9ecf5f47b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc479a7-01a4-4542-ba20-fb9940274d47", "tag": "d0280365-24f6-4acb-be5d-6150915fc998"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:59:43.473005 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-7a384bdc-6456-4895-8d86-f137c736cbca req-8563c6fb-f99d-431c-b151-f9ecf5f47b54 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:43.473747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-7a384bdc-6456-4895-8d86-f137c736cbca req-8563c6fb-f99d-431c-b151-f9ecf5f47b54 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:43.491621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-7a384bdc-6456-4895-8d86-f137c736cbca req-8563c6fb-f99d-431c-b151-f9ecf5f47b54 service nova] Creating event network-changed:d0280365-24f6-4acb-be5d-6150915fc998 for instance 6bc479a7-01a4-4542-ba20-fb9940274d47 on hv-cinder-84614 Jun 23 10:59:43.496793 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-7a384bdc-6456-4895-8d86-f137c736cbca req-8563c6fb-f99d-431c-b151-f9ecf5f47b54 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039594 Jun 23 10:59:43.497684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 484/998] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 10:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:00:03.494453 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b7fa538e-dbc0-4130-8848-baa43846290a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:03.495099 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b7fa538e-dbc0-4130-8848-baa43846290a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:03.497224 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=19 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:03.497905 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=13 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:03.504185 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b7fa538e-dbc0-4130-8848-baa43846290a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:03.504641 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b7fa538e-dbc0-4130-8848-baa43846290a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:03.505431 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b7fa538e-dbc0-4130-8848-baa43846290a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:03.505873 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b7fa538e-dbc0-4130-8848-baa43846290a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:03.532996 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b7fa538e-dbc0-4130-8848-baa43846290a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/ips" status: 200 len: 148 microversion: 2.1 time: 0.045485 Jun 23 11:00:03.533587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 515/999] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 11:00:03 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:04.922167 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=23 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:04.922949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=9 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:04.927468 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-494a8d1f-ff7a-45f6-93cc-41ec272aebe6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "860e8bba-1193-4895-a3d5-d11bb0ae2a31"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:00:04.928630 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-494a8d1f-ff7a-45f6-93cc-41ec272aebe6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:04.936705 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-494a8d1f-ff7a-45f6-93cc-41ec272aebe6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:04.937156 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-494a8d1f-ff7a-45f6-93cc-41ec272aebe6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:04.937937 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-494a8d1f-ff7a-45f6-93cc-41ec272aebe6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:04.938408 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-494a8d1f-ff7a-45f6-93cc-41ec272aebe6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:05.268040 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-494a8d1f-ff7a-45f6-93cc-41ec272aebe6 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "POST /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347140 Jun 23 11:00:05.268740 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 485/1000] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 11:00:04 2022] POST /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:12.870684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4723307e-31a1-470b-8e8e-8a97b8eab2b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:12.871693 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4723307e-31a1-470b-8e8e-8a97b8eab2b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:12.877690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4723307e-31a1-470b-8e8e-8a97b8eab2b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:12.878141 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4723307e-31a1-470b-8e8e-8a97b8eab2b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:12.878966 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4723307e-31a1-470b-8e8e-8a97b8eab2b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:12.879403 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4723307e-31a1-470b-8e8e-8a97b8eab2b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:13.012145 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-4723307e-31a1-470b-8e8e-8a97b8eab2b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lazy-loading 'services' on Instance uuid 24d5d2ac-766a-47cf-8a08-8512d6ff439b {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:00:13.084383 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4723307e-31a1-470b-8e8e-8a97b8eab2b3 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments/860e8bba-1193-4895-a3d5-d11bb0ae2a31" status: 202 len: 0 microversion: 2.1 time: 0.217435 Jun 23 11:00:13.085036 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 516/1001] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 11:00:12 2022] DELETE /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments/860e8bba-1193-4895-a3d5-d11bb0ae2a31 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:00:13.094178 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-918f4177-b4b9-4b26-b0e0-7ce28b3ffe32 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:13.095360 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-918f4177-b4b9-4b26-b0e0-7ce28b3ffe32 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:13.102449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-918f4177-b4b9-4b26-b0e0-7ce28b3ffe32 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:13.102947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-918f4177-b4b9-4b26-b0e0-7ce28b3ffe32 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:13.103794 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-918f4177-b4b9-4b26-b0e0-7ce28b3ffe32 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:13.104228 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-918f4177-b4b9-4b26-b0e0-7ce28b3ffe32 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:13.138042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-918f4177-b4b9-4b26-b0e0-7ce28b3ffe32 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048368 Jun 23 11:00:13.138604 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 486/1002] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 11:00:13 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:14.150331 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-61ceb779-ab27-4dbe-952f-baba6772b98b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:14.151547 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-61ceb779-ab27-4dbe-952f-baba6772b98b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:14.159160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-61ceb779-ab27-4dbe-952f-baba6772b98b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:14.159612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-61ceb779-ab27-4dbe-952f-baba6772b98b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:14.160390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-61ceb779-ab27-4dbe-952f-baba6772b98b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:14.161098 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-61ceb779-ab27-4dbe-952f-baba6772b98b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:14.192815 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-61ceb779-ab27-4dbe-952f-baba6772b98b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047310 Jun 23 11:00:14.193389 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 517/1003] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 11:00:14 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:15.205395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9ab684f2-7d58-4b8c-a717-8d446d852196 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:15.206307 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9ab684f2-7d58-4b8c-a717-8d446d852196 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:15.212827 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9ab684f2-7d58-4b8c-a717-8d446d852196 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:15.213282 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9ab684f2-7d58-4b8c-a717-8d446d852196 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:15.214050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9ab684f2-7d58-4b8c-a717-8d446d852196 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:15.214540 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9ab684f2-7d58-4b8c-a717-8d446d852196 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:15.243843 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9ab684f2-7d58-4b8c-a717-8d446d852196 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042563 Jun 23 11:00:15.244587 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 487/1004] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 11:00:15 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:00:15.303556 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-94f645a2-bc89-46a6-bf19-7db422703925 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:15.304050 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-94f645a2-bc89-46a6-bf19-7db422703925 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:15.311240 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-94f645a2-bc89-46a6-bf19-7db422703925 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:15.311687 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-94f645a2-bc89-46a6-bf19-7db422703925 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:15.312479 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-94f645a2-bc89-46a6-bf19-7db422703925 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:15.312908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-94f645a2-bc89-46a6-bf19-7db422703925 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:15.337832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-94f645a2-bc89-46a6-bf19-7db422703925 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:00:15.413013 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-94f645a2-bc89-46a6-bf19-7db422703925 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 204 len: 0 microversion: 2.1 time: 0.113132 Jun 23 11:00:15.413604 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 518/1005] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:00:15 2022] DELETE /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:00:15.422430 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b641643b-fa8c-4537-9cff-d601aa2ff056 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:15.423040 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b641643b-fa8c-4537-9cff-d601aa2ff056 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:15.429031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b641643b-fa8c-4537-9cff-d601aa2ff056 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:15.429471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b641643b-fa8c-4537-9cff-d601aa2ff056 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:15.430235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b641643b-fa8c-4537-9cff-d601aa2ff056 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:15.430776 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b641643b-fa8c-4537-9cff-d601aa2ff056 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:15.565008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b641643b-fa8c-4537-9cff-d601aa2ff056 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:15.574132 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b641643b-fa8c-4537-9cff-d601aa2ff056 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1679 microversion: 2.1 time: 0.156107 Jun 23 11:00:15.574913 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 488/1006] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:15 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:00:16.592119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-450a0906-4bf0-4977-b2db-0687b828c28a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:16.592800 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-450a0906-4bf0-4977-b2db-0687b828c28a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:16.599229 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-450a0906-4bf0-4977-b2db-0687b828c28a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:16.599670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-450a0906-4bf0-4977-b2db-0687b828c28a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:16.600416 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-450a0906-4bf0-4977-b2db-0687b828c28a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:16.600842 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-450a0906-4bf0-4977-b2db-0687b828c28a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:16.735130 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-450a0906-4bf0-4977-b2db-0687b828c28a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:16.742661 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-450a0906-4bf0-4977-b2db-0687b828c28a tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1679 microversion: 2.1 time: 0.154782 Jun 23 11:00:16.743214 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 519/1007] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:16 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:00:17.759816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2e9d9a8f-8de9-4070-8b0a-bffae1cc905e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:17.760420 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2e9d9a8f-8de9-4070-8b0a-bffae1cc905e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:17.767773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2e9d9a8f-8de9-4070-8b0a-bffae1cc905e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:17.768224 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2e9d9a8f-8de9-4070-8b0a-bffae1cc905e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:17.768996 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2e9d9a8f-8de9-4070-8b0a-bffae1cc905e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:17.769433 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2e9d9a8f-8de9-4070-8b0a-bffae1cc905e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:17.900406 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2e9d9a8f-8de9-4070-8b0a-bffae1cc905e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8df5670686403480cdfd32ac408945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2123ff10502044b9aea48720440c2291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:17.909300 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2e9d9a8f-8de9-4070-8b0a-bffae1cc905e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 200 len: 1679 microversion: 2.1 time: 0.153273 Jun 23 11:00:17.909868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 489/1008] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:17 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:00:18.406559 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-a81b7b9a-3ecd-455e-9d38-8590cd8263cd req-0f1a504a-d2bb-464e-9598-9ba74815348d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d5d2ac-766a-47cf-8a08-8512d6ff439b", "name": "network-vif-deleted", "tag": "23e8732a-8d7d-4ecb-b429-785063a38ac1"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:00:18.419902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-a81b7b9a-3ecd-455e-9d38-8590cd8263cd req-0f1a504a-d2bb-464e-9598-9ba74815348d service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:18.420698 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-a81b7b9a-3ecd-455e-9d38-8590cd8263cd req-0f1a504a-d2bb-464e-9598-9ba74815348d service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:18.435579 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-a81b7b9a-3ecd-455e-9d38-8590cd8263cd req-0f1a504a-d2bb-464e-9598-9ba74815348d service nova] Creating event network-vif-deleted:23e8732a-8d7d-4ecb-b429-785063a38ac1 for instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b on hv-cinder-84614 Jun 23 11:00:18.440793 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-a81b7b9a-3ecd-455e-9d38-8590cd8263cd req-0f1a504a-d2bb-464e-9598-9ba74815348d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039459 Jun 23 11:00:18.441387 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 520/1009] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:18.927688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:18.928334 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:18.935510 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:18.935955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:18.936748 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:18.937181 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:18.951271 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b HTTP/1.1 Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:18.953182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:18.954875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '24d5d2ac-766a-47cf-8a08-8512d6ff439b'} Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:18.955849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:18.957142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:18.958288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:18.958288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c4cd09ea-7eb3-4f41-ba92-e63bede4332d tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 404 len: 111 microversion: 2.1 time: 0.031788 Jun 23 11:00:18.958288 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 490/1010] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:18 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:18.965328 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-5fcbbf8f-f4b8-4ae4-9cd4-afc577d3f16e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '.version_select at 0x7f8dc90d5e50>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:18.986808 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-5fcbbf8f-f4b8-4ae4-9cd4-afc577d3f16e tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-635017521" status: 202 len: 0 microversion: 2.1 time: 0.023124 Jun 23 11:00:18.987813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 521/1011] 10.222.0.39 () {58 vars in 1217 bytes} [Thu Jun 23 11:00:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-635017521 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:00:20.722910 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:20.723397 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:20.729964 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:20.730676 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:20.731445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:20.731871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:20.744885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b HTTP/1.1 Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:20.747008 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.748621 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '24d5d2ac-766a-47cf-8a08-8512d6ff439b'} Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:20.749500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.750955 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.752324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:20.752324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-75c1aaff-f1c6-44bf-ba31-ce4d0d1e07ad tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 404 len: 111 microversion: 2.1 time: 0.029231 Jun 23 11:00:20.752324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 491/1012] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:00:20 2022] DELETE /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:20.757291 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:20.758015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 24d5d2ac-766a-47cf-8a08-8512d6ff439b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:20.765034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:20.765478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:20.766230 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:20.766685 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:20.780011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b HTTP/1.1 Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:00:20.781605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.783188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '24d5d2ac-766a-47cf-8a08-8512d6ff439b'} Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:20.784183 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. Jun 23 11:00:20.785657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:20.786938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance 24d5d2ac-766a-47cf-8a08-8512d6ff439b could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:20.786938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-19b64d0f-1089-42c9-9331-f51a81fcad5b tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b" status: 404 len: 111 microversion: 2.1 time: 0.030045 Jun 23 11:00:20.786938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 522/1013] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:20 2022] GET /compute/v2.1/servers/24d5d2ac-766a-47cf-8a08-8512d6ff439b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:21.918721 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:21.919388 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:21.925881 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:21.926368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:21.927138 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:21.927571 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:21.941747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 HTTP/1.1 Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:21.943357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.946158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '988e9d74-e535-4569-9f46-7970232b6723'} Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:21.947441 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.948927 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.950564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:21.950564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b7b4530f-cd00-4b19-bf9b-08ff951fa1c4 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 404 len: 111 microversion: 2.1 time: 0.030588 Jun 23 11:00:21.950564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 492/1014] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:00:21 2022] DELETE /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:21.953900 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:21.954547 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 988e9d74-e535-4569-9f46-7970232b6723] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:21.961023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:21.961468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:21.962225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:21.963277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:21.976733 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 HTTP/1.1 Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:00:21.978265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.980059 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '988e9d74-e535-4569-9f46-7970232b6723'} Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:21.981631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. Jun 23 11:00:21.983506 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:21.984912 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance 988e9d74-e535-4569-9f46-7970232b6723 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:21.984912 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ad1f1549-e97a-4426-9e13-ca5165283249 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723" status: 404 len: 111 microversion: 2.1 time: 0.030052 Jun 23 11:00:21.984912 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 523/1015] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:21 2022] GET /compute/v2.1/servers/988e9d74-e535-4569-9f46-7970232b6723 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:00:21.990047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:21.990582 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:21.997250 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:21.997683 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:21.998465 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:21.998896 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:22.012120 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 HTTP/1.1 Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:22.013633 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.015318 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '2112b96a-009d-4c3d-90ac-aaa4acd04593'} Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:22.016151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.017602 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.019126 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:22.019126 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b3948004-3ece-4c35-9b6d-e02a02288d99 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 404 len: 111 microversion: 2.1 time: 0.028761 Jun 23 11:00:22.019126 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 493/1016] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:00:21 2022] DELETE /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:22.023393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:22.024000 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: 2112b96a-009d-4c3d-90ac-aaa4acd04593] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:22.030165 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:22.030659 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:22.031415 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:22.031851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:22.045680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 HTTP/1.1 Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:00:22.047209 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.048751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '2112b96a-009d-4c3d-90ac-aaa4acd04593'} Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:22.049652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. Jun 23 11:00:22.051115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:22.052522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance 2112b96a-009d-4c3d-90ac-aaa4acd04593 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:22.052522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-484e7cdf-a357-41e4-a311-d681fc9096ed tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593" status: 404 len: 111 microversion: 2.1 time: 0.028994 Jun 23 11:00:22.052522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 524/1017] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:22 2022] GET /compute/v2.1/servers/2112b96a-009d-4c3d-90ac-aaa4acd04593 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:23.187712 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:23.188201 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:23.194242 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:23.194714 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:23.195463 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:23.195888 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:23.209536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 HTTP/1.1 Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:23.211031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.212692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': 'b14d1ef1-2756-4058-a3e8-52c83a121833'} Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:23.214368 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.216473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.217908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:23.217908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2f0526d9-53ea-4512-a254-eea8c9b1cbfb tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 404 len: 111 microversion: 2.1 time: 0.028480 Jun 23 11:00:23.217908 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 494/1018] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:00:23 2022] DELETE /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:23.221670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:23.222282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] [instance: b14d1ef1-2756-4058-a3e8-52c83a121833] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:23.228785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:23.229228 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:23.229986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:23.231101 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:23.244545 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] HTTP exception thrown: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Request method failure captured: Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 HTTP/1.1 Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVgZPlPoaJG6HkUe0zmbconYYpyM_UI7gc3GhCGKNUfsYiMUFWbZY9S7l12OdX5QO6KedMxCzahoTaTJmlmqY3L5A3QBTHCXmiOTr59zLsHrreS5HgQkKaLCTi39tMgxgluz6kEiv7eGVjxSEkWSECY7v5iLiZeU6C7KPYgOq8O-mQ Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:00:23.246128 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2123ff10502044b9aea48720440c2291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2123ff10502044b9aea48720440c2291", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2123ff10502044b9aea48720440c2291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 2123ff10502044b9aea48720440c2291 Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-702239721 Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: eb8df5670686403480cdfd32ac408945 Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeNegativeTest-702239721-project Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.247680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'b14d1ef1-2756-4058-a3e8-52c83a121833'} Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:23.251984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. Jun 23 11:00:23.253651 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:23.254783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] Returning 404 to user: Instance b14d1ef1-2756-4058-a3e8-52c83a121833 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:23.254783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-be9fa613-8d3c-4431-90d6-a1746a788455 tempest-AttachVolumeNegativeTest-702239721 tempest-AttachVolumeNegativeTest-702239721-project] 10.222.0.39 "GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833" status: 404 len: 111 microversion: 2.1 time: 0.029851 Jun 23 11:00:23.254783 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 525/1019] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:23 2022] GET /compute/v2.1/servers/b14d1ef1-2756-4058-a3e8-52c83a121833 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:27.744209 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-53a7784a-2681-42b1-b11e-104109ec53c8 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Action: 'create', calling method: .version_select at 0x7f8dc92f94c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2043161891"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:00:28.004223 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9b2040a5-d481-4588-85ba-6293cf65ea16 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:28.005139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9b2040a5-d481-4588-85ba-6293cf65ea16 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:28.012986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b2040a5-d481-4588-85ba-6293cf65ea16 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:28.013442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b2040a5-d481-4588-85ba-6293cf65ea16 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:28.014216 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b2040a5-d481-4588-85ba-6293cf65ea16 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:28.014684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9b2040a5-d481-4588-85ba-6293cf65ea16 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:28.048466 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9b2040a5-d481-4588-85ba-6293cf65ea16 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048314 Jun 23 11:00:28.049012 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 526/1020] 10.222.0.39 () {60 vars in 1342 bytes} [Thu Jun 23 11:00:27 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:00:28.081563 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-53a7784a-2681-42b1-b11e-104109ec53c8 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.482575 Jun 23 11:00:28.082204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 495/1021] 10.222.0.39 () {60 vars in 1154 bytes} [Thu Jun 23 11:00:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 484 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 23 11:00:28.093775 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3ff45de9-919a-49f2-bb24-878258fa9f6f tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc922ce50>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:28.115130 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3d81e608-c606-47be-806c-fe442e227811 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:28.115620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3d81e608-c606-47be-806c-fe442e227811 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:28.123383 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3d81e608-c606-47be-806c-fe442e227811 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:28.124074 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3d81e608-c606-47be-806c-fe442e227811 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:28.124837 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3d81e608-c606-47be-806c-fe442e227811 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:28.125513 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3d81e608-c606-47be-806c-fe442e227811 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:28.146932 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3ff45de9-919a-49f2-bb24-878258fa9f6f tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75" status: 200 len: 345 microversion: 2.1 time: 0.057714 Jun 23 11:00:28.147513 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 527/1022] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 11:00:28 2022] GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:28.154850 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3d81e608-c606-47be-806c-fe442e227811 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Going to try to terminate instance {{(pid=129461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:00:28.233841 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3d81e608-c606-47be-806c-fe442e227811 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 204 len: 0 microversion: 2.20 time: 0.122755 Jun 23 11:00:28.234594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 496/1023] 10.222.0.39 () {60 vars in 1279 bytes} [Thu Jun 23 11:00:28 2022] DELETE /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 11:00:28.243191 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:28.243796 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:28.250597 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:28.251047 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:28.251807 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:28.252246 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:28.383553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:28.392616 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:28.394110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:28.395290 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-de161b46-bbad-427c-854f-4b68a5756d85 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.156309 Jun 23 11:00:28.395838 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 528/1024] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 11:00:28 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:00:29.160073 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f1cf61fd-f26d-4e6b-8e79-245165868c0c tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc92f9940>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:29.208797 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f1cf61fd-f26d-4e6b-8e79-245165868c0c tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75" status: 200 len: 346 microversion: 2.1 time: 0.052833 Jun 23 11:00:29.209358 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 497/1025] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 11:00:29 2022] GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:29.221037 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d77fa2d3-742e-4fe6-9c13-54a5ac27230e tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Action: 'create', calling method: .version_select at 0x7f8dc939b310>, body: {"snapshot": {"volume_id": "dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1609773293"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:00:29.381199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d77fa2d3-742e-4fe6-9c13-54a5ac27230e tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.163952 Jun 23 11:00:29.381908 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 529/1026] 10.222.0.39 () {60 vars in 1161 bytes} [Thu Jun 23 11:00:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:29.393481 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e7be2fda-3f2f-4b14-9ad1-77c95975ab2b tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc939f280>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:29.414123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:29.414815 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:29.422163 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:29.422678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:29.423792 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:29.424301 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:29.432960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e7be2fda-3f2f-4b14-9ad1-77c95975ab2b tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 200 len: 287 microversion: 2.1 time: 0.044041 Jun 23 11:00:29.434110 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 498/1027] 10.222.0.39 () {58 vars in 1250 bytes} [Thu Jun 23 11:00:29 2022] GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:00:29.443652 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2f657b59-d7ec-4d52-a2b7-12c0f8c7e297 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc92f03a0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:29.477717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2f657b59-d7ec-4d52-a2b7-12c0f8c7e297 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037655 Jun 23 11:00:29.478279 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 499/1028] 10.222.0.39 () {58 vars in 1139 bytes} [Thu Jun 23 11:00:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:00:29.488575 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e3fd33f6-0399-4e6c-bf80-eaafabd928be tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc939f820>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:29.521934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e3fd33f6-0399-4e6c-bf80-eaafabd928be tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 200 len: 287 microversion: 2.1 time: 0.035709 Jun 23 11:00:29.522792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 500/1029] 10.222.0.39 () {58 vars in 1250 bytes} [Thu Jun 23 11:00:29 2022] GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:00:29.567213 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:29.575218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:29.576698 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:29.577835 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-decdfa97-4247-44d4-8049-e78edd16b2ea tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.167840 Jun 23 11:00:29.578673 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 530/1030] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 11:00:29 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:00:30.534984 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-40625294-92d6-4453-b5a4-820dbe808a8b tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc92d5ee0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:30.566085 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-40625294-92d6-4453-b5a4-820dbe808a8b tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 200 len: 287 microversion: 2.1 time: 0.035517 Jun 23 11:00:30.566691 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 501/1031] 10.222.0.39 () {58 vars in 1250 bytes} [Thu Jun 23 11:00:30 2022] GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:30.596743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:30.597468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:30.603975 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:30.604413 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:30.605163 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:30.606286 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:30.734691 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:30.742609 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:30.744091 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:30.745231 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f324b7de-fd32-417a-99c4-09b510b1f24f tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.152362 Jun 23 11:00:30.745776 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 531/1032] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 11:00:30 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:00:31.579753 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7d3fac29-fe03-40e3-9ce2-f27e69d31936 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc9295310>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:31.614646 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7d3fac29-fe03-40e3-9ce2-f27e69d31936 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 200 len: 287 microversion: 2.1 time: 0.041094 Jun 23 11:00:31.615206 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 502/1033] 10.222.0.39 () {58 vars in 1250 bytes} [Thu Jun 23 11:00:31 2022] GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:31.764369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:31.764967 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:31.771613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:31.772076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:31.772857 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:31.773284 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:31.922526 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:31.930973 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:31.932464 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:31.934203 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1970a88d-26bc-459b-9dc4-95b124df7ea4 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.174012 Jun 23 11:00:31.934930 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 532/1034] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 11:00:31 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:00:32.629861 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fbb07ae2-506b-4906-8565-9fc80190e41b tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc939f670>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:32.660995 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fbb07ae2-506b-4906-8565-9fc80190e41b tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 200 len: 287 microversion: 2.1 time: 0.036278 Jun 23 11:00:32.661601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 503/1035] 10.222.0.39 () {58 vars in 1250 bytes} [Thu Jun 23 11:00:32 2022] GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:32.954076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:32.954664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:32.961286 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:32.961728 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:32.962544 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:32.962981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:33.097910 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:33.106363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:33.107859 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:33.109035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-af503ea1-77a3-4d2e-a58f-79888d3bde13 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.159290 Jun 23 11:00:33.109730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 533/1036] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 11:00:32 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:00:33.673995 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ce8cf65c-8dfd-4e64-8d62-42064ab930af tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc9295700>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:33.705141 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ce8cf65c-8dfd-4e64-8d62-42064ab930af tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 200 len: 287 microversion: 2.1 time: 0.035428 Jun 23 11:00:33.705708 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 504/1037] 10.222.0.39 () {58 vars in 1250 bytes} [Thu Jun 23 11:00:33 2022] GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:34.130113 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:34.131184 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:34.136214 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:34.140939 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:34.141396 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:34.142188 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:34.142647 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:34.146034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:34.293787 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:34.301929 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:34.303486 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b95c321c4a452faa81a93168c7bf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11861d35a3444734be8870f47cce1b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:34.304641 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4a47c791-a1d9-4ad0-b59e-772328fb26d3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 200 len: 1723 microversion: 2.20 time: 0.180733 Jun 23 11:00:34.305198 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 534/1038] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 11:00:34 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:00:34.651413 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-2bafb8a5-8b14-472c-bae8-09909e377e73 req-5d33fb78-e3b2-4673-9729-30257f58202e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf2c8ff-3746-44d7-9eeb-96dc1c860432", "name": "network-vif-deleted", "tag": "42635af4-43f0-435c-bf3e-bc1aabbcf87a"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:00:34.665052 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-2bafb8a5-8b14-472c-bae8-09909e377e73 req-5d33fb78-e3b2-4673-9729-30257f58202e service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:34.665623 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-2bafb8a5-8b14-472c-bae8-09909e377e73 req-5d33fb78-e3b2-4673-9729-30257f58202e service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:34.677845 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-2bafb8a5-8b14-472c-bae8-09909e377e73 req-5d33fb78-e3b2-4673-9729-30257f58202e service nova] Creating event network-vif-deleted:42635af4-43f0-435c-bf3e-bc1aabbcf87a for instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 on hv-cinder-84614 Jun 23 11:00:34.685198 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-2bafb8a5-8b14-472c-bae8-09909e377e73 req-5d33fb78-e3b2-4673-9729-30257f58202e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037325 Jun 23 11:00:34.686794 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 505/1039] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:34.717811 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e25ed130-b37a-4aa8-977c-78b0913a29d2 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc925b430>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:34.755148 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e25ed130-b37a-4aa8-977c-78b0913a29d2 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 200 len: 288 microversion: 2.1 time: 0.042082 Jun 23 11:00:34.755923 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 535/1040] 10.222.0.39 () {58 vars in 1250 bytes} [Thu Jun 23 11:00:34 2022] GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 288 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:34.768429 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8f45f1f4-1d5d-4202-bce1-0994aa35c59b tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc939fee0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:34.837297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8f45f1f4-1d5d-4202-bce1-0994aa35c59b tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 202 len: 0 microversion: 2.1 time: 0.073647 Jun 23 11:00:34.837896 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 506/1041] 10.222.0.39 () {58 vars in 1253 bytes} [Thu Jun 23 11:00:34 2022] DELETE /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:00:34.846985 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9e4ee1c9-06ea-4b3e-98b2-6e3f7fd33738 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc907b5e0>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:34.879058 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9e4ee1c9-06ea-4b3e-98b2-6e3f7fd33738 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 200 len: 287 microversion: 2.1 time: 0.035934 Jun 23 11:00:34.879638 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 536/1042] 10.222.0.39 () {58 vars in 1250 bytes} [Thu Jun 23 11:00:34 2022] GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:35.323591 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:35.325015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:35.327100 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:35.333210 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:35.333774 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:35.334668 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:35.335171 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:35.338964 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:35.352485 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] HTTP exception thrown: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Request method failure captured: Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 HTTP/1.1 Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVe-43zMedEC24gk9dDiHodLgofVqJ-VL8OuBhwyG8fI0Jd0H7TbrS9OWBanIjwu6h4bphPgWKlYUvdCytIKooRxNfUMLExgaA3pzX7u8KJ9CsfwlCnOOSDTSKw4uh5pp5iLfCf8g1Dh4Wy2_Uv5TC9GGVvemQmWacbZ-rVM6fltq0 Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:35.354220 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11861d35a3444734be8870f47cce1b9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: b0b95c321c4a452faa81a93168c7bf0a Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:35.357058 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '5cf2c8ff-3746-44d7-9eeb-96dc1c860432'} Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:35.358009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:35.359770 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.361270 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Returning 404 to user: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:35.361270 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d3e2a9cf-60f2-44ce-a16a-6c915410a4e3 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 404 len: 111 microversion: 2.20 time: 0.037552 Jun 23 11:00:35.361270 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 507/1043] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 11:00:35 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:00:35.367928 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4efaa682-e388-4e44-b1a2-751049872db2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '.version_select at 0x7f8dc939b940>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:35.388200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4efaa682-e388-4e44-b1a2-751049872db2 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786109015" status: 204 len: 0 microversion: 2.20 time: 0.024372 Jun 23 11:00:35.388995 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 537/1044] 10.222.0.39 () {60 vars in 1258 bytes} [Thu Jun 23 11:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786109015 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 11:00:35.891815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-93e0c405-85ba-4f5b-9be2-62f09350aff1 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc939f550>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:35.919370 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-93e0c405-85ba-4f5b-9be2-62f09350aff1 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] HTTP exception thrown: Snapshot 10260ba9-c4fd-43d3-9df3-24ebd3209c91 could not be found. Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-93e0c405-85ba-4f5b-9be2-62f09350aff1 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Request method failure captured: Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 HTTP/1.1 Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEfLWffdJG_K0YOS6sxK5uT77X6HLrJbpg_pfWTz7lNDvIXd1KzPdbPFyl9IwbEeeh2ryMXHyPBQ0lavuLFaNhWWt0QZK1usvyLMV_9YDMEtcQ3sJ8Llodwz6_otDSKCw3Czw7dWWwDtoHpEZnzAAwRoCPkve7Z6Cl_7BfBIvYRVZas Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 5c99201bdc7f49a0bd87bc7fa1002f1b Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:35.921601 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c99201bdc7f49a0bd87bc7fa1002f1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 5c99201bdc7f49a0bd87bc7fa1002f1b Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesSnapshotsTestJSON-1446379523-project Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: 2fef5799a5e443b382cfdebb9ec43c9c Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1446379523-project Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Snapshot 10260ba9-c4fd-43d3-9df3-24ebd3209c91 could not be found. Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '10260ba9-c4fd-43d3-9df3-24ebd3209c91'} Jun 23 11:00:35.923339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 10260ba9-c4fd-43d3-9df3-24ebd3209c91 could not be found. (HTTP 404) (Request-ID: req-12abf3c9-3ecb-4cf1-ac46-d772252ad47a) Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.924396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:00:35.927742 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 10260ba9-c4fd-43d3-9df3-24ebd3209c91 could not be found. Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 11:00:35.929638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 10260ba9-c4fd-43d3-9df3-24ebd3209c91 could not be found. Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 10260ba9-c4fd-43d3-9df3-24ebd3209c91 could not be found. Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-93e0c405-85ba-4f5b-9be2-62f09350aff1 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Returning 404 to user: Snapshot 10260ba9-c4fd-43d3-9df3-24ebd3209c91 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:35.931808 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-93e0c405-85ba-4f5b-9be2-62f09350aff1 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91" status: 404 len: 111 microversion: 2.1 time: 0.035534 Jun 23 11:00:35.933046 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 508/1045] 10.222.0.39 () {58 vars in 1250 bytes} [Thu Jun 23 11:00:35 2022] GET /compute/v2.1/os-snapshots/10260ba9-c4fd-43d3-9df3-24ebd3209c91 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:00:35.936301 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-11c87fbd-8ecf-4f3d-95ab-06fa4e00156c tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc939bc10>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:36.007697 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-11c87fbd-8ecf-4f3d-95ab-06fa4e00156c tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75" status: 202 len: 0 microversion: 2.1 time: 0.076089 Jun 23 11:00:36.008792 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 538/1046] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 11:00:35 2022] DELETE /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:00:36.021769 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-caf56d41-12c7-4de3-9583-9d37cf9fa9d9 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc92f9ee0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:36.086048 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-caf56d41-12c7-4de3-9583-9d37cf9fa9d9 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75" status: 200 len: 345 microversion: 2.1 time: 0.069363 Jun 23 11:00:36.086673 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 509/1047] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 11:00:36 2022] GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:37.099273 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7cb53e12-7f81-45f0-8f1e-b2b720ea9c60 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc925b040>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:37.128036 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-7cb53e12-7f81-45f0-8f1e-b2b720ea9c60 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] HTTP exception thrown: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7cb53e12-7f81-45f0-8f1e-b2b720ea9c60 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Request method failure captured: Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 HTTP/1.1 Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEfLWffdJG_K0YOS6sxK5uT77X6HLrJbpg_pfWTz7lNDvIXd1KzPdbPFyl9IwbEeeh2ryMXHyPBQ0lavuLFaNhWWt0QZK1usvyLMV_9YDMEtcQ3sJ8Llodwz6_otDSKCw3Czw7dWWwDtoHpEZnzAAwRoCPkve7Z6Cl_7BfBIvYRVZas Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 5c99201bdc7f49a0bd87bc7fa1002f1b Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:00:37.137678 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c99201bdc7f49a0bd87bc7fa1002f1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 5c99201bdc7f49a0bd87bc7fa1002f1b Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-VolumesSnapshotsTestJSON-1446379523-project Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 2fef5799a5e443b382cfdebb9ec43c9c Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1446379523-project Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75'} Jun 23 11:00:37.139348 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. (HTTP 404) (Request-ID: req-a918dd74-0b5b-48f3-ba39-8e59874382d2) Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.140492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:00:37.141888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:00:37.143639 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7cb53e12-7f81-45f0-8f1e-b2b720ea9c60 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Returning 404 to user: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7cb53e12-7f81-45f0-8f1e-b2b720ea9c60 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75" status: 404 len: 109 microversion: 2.1 time: 0.044258 Jun 23 11:00:37.145119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 539/1048] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 11:00:37 2022] GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:37.154859 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6c5a78d2-5272-482e-bc31-9c138cb3512f tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc92d5820>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:37.182614 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-6c5a78d2-5272-482e-bc31-9c138cb3512f tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] HTTP exception thrown: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6c5a78d2-5272-482e-bc31-9c138cb3512f tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Request method failure captured: Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 HTTP/1.1 Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEfLWffdJG_K0YOS6sxK5uT77X6HLrJbpg_pfWTz7lNDvIXd1KzPdbPFyl9IwbEeeh2ryMXHyPBQ0lavuLFaNhWWt0QZK1usvyLMV_9YDMEtcQ3sJ8Llodwz6_otDSKCw3Czw7dWWwDtoHpEZnzAAwRoCPkve7Z6Cl_7BfBIvYRVZas Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 5c99201bdc7f49a0bd87bc7fa1002f1b Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:37.185469 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c99201bdc7f49a0bd87bc7fa1002f1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 5c99201bdc7f49a0bd87bc7fa1002f1b Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesSnapshotsTestJSON-1446379523-project Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: 2fef5799a5e443b382cfdebb9ec43c9c Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1446379523-project Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': 'dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75'} Jun 23 11:00:37.187034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. (HTTP 404) (Request-ID: req-33c4e556-df31-4a12-8c6c-bb901d713246) Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:00:37.189435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 11:00:37.190842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6c5a78d2-5272-482e-bc31-9c138cb3512f tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Returning 404 to user: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:37.192254 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6c5a78d2-5272-482e-bc31-9c138cb3512f tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75" status: 404 len: 109 microversion: 2.1 time: 0.037560 Jun 23 11:00:37.193212 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 510/1049] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 11:00:37 2022] DELETE /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:37.196155 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0e0a994a-4a36-4b97-a62f-b7a25d810440 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Calling method '.version_select at 0x7f8dc9720af0>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:37.225142 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-0e0a994a-4a36-4b97-a62f-b7a25d810440 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] HTTP exception thrown: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0e0a994a-4a36-4b97-a62f-b7a25d810440 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Request method failure captured: Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 HTTP/1.1 Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEfLWffdJG_K0YOS6sxK5uT77X6HLrJbpg_pfWTz7lNDvIXd1KzPdbPFyl9IwbEeeh2ryMXHyPBQ0lavuLFaNhWWt0QZK1usvyLMV_9YDMEtcQ3sJ8Llodwz6_otDSKCw3Czw7dWWwDtoHpEZnzAAwRoCPkve7Z6Cl_7BfBIvYRVZas Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 5c99201bdc7f49a0bd87bc7fa1002f1b Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:00:37.227115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c99201bdc7f49a0bd87bc7fa1002f1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c99201bdc7f49a0bd87bc7fa1002f1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 5c99201bdc7f49a0bd87bc7fa1002f1b Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1446379523 Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-VolumesSnapshotsTestJSON-1446379523-project Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 2fef5799a5e443b382cfdebb9ec43c9c Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1446379523-project Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75'} Jun 23 11:00:37.228756 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. (HTTP 404) (Request-ID: req-c27b98f9-e953-42ef-92ae-98b70f71c9bd) Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.229716 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:00:37.231180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:00:37.232613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0e0a994a-4a36-4b97-a62f-b7a25d810440 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] Returning 404 to user: Volume dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0e0a994a-4a36-4b97-a62f-b7a25d810440 tempest-VolumesSnapshotsTestJSON-1446379523 tempest-VolumesSnapshotsTestJSON-1446379523-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75" status: 404 len: 109 microversion: 2.1 time: 0.036997 Jun 23 11:00:37.234003 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 540/1050] 10.222.0.39 () {58 vars in 1244 bytes} [Thu Jun 23 11:00:37 2022] GET /compute/v2.1/os-volumes/dc4a4e9f-09f0-4507-a6a9-8d1092ca5c75 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:00:37.241656 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:37.242338 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:37.250509 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:37.250960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:37.251737 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:37.252168 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:37.271684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] HTTP exception thrown: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Request method failure captured: Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 HTTP/1.1 Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVe-43zMedEC24gk9dDiHodLgofVqJ-VL8OuBhwyG8fI0Jd0H7TbrS9OWBanIjwu6h4bphPgWKlYUvdCytIKooRxNfUMLExgaA3pzX7u8KJ9CsfwlCnOOSDTSKw4uh5pp5iLfCf8g1Dh4Wy2_Uv5TC9GGVvemQmWacbZ-rVM6fltq0 Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:37.273292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11861d35a3444734be8870f47cce1b9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: b0b95c321c4a452faa81a93168c7bf0a Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.275917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '5cf2c8ff-3746-44d7-9eeb-96dc1c860432'} Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:37.276907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.279155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.280691 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Returning 404 to user: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:37.280691 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a8621489-7f69-4a10-9acb-ee2507888d07 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 404 len: 111 microversion: 2.20 time: 0.037166 Jun 23 11:00:37.280691 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 511/1051] 10.222.0.39 () {60 vars in 1279 bytes} [Thu Jun 23 11:00:37 2022] DELETE /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:00:37.285350 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:37.286065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 5cf2c8ff-3746-44d7-9eeb-96dc1c860432] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:37.293572 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:37.294035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:37.294880 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:37.295459 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:37.315415 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] HTTP exception thrown: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Request method failure captured: Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 HTTP/1.1 Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVe-43zMedEC24gk9dDiHodLgofVqJ-VL8OuBhwyG8fI0Jd0H7TbrS9OWBanIjwu6h4bphPgWKlYUvdCytIKooRxNfUMLExgaA3pzX7u8KJ9CsfwlCnOOSDTSKw4uh5pp5iLfCf8g1Dh4Wy2_Uv5TC9GGVvemQmWacbZ-rVM6fltq0 Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:00:37.316986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11861d35a3444734be8870f47cce1b9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: b0b95c321c4a452faa81a93168c7bf0a Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.318709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '5cf2c8ff-3746-44d7-9eeb-96dc1c860432'} Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:37.319759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. Jun 23 11:00:37.321289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:37.323546 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Returning 404 to user: Instance 5cf2c8ff-3746-44d7-9eeb-96dc1c860432 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:37.323546 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e6eebb15-a9e4-4679-a99d-cd44984a4e2d tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432" status: 404 len: 111 microversion: 2.20 time: 0.037862 Jun 23 11:00:37.323546 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 541/1052] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 11:00:37 2022] GET /compute/v2.1/servers/5cf2c8ff-3746-44d7-9eeb-96dc1c860432 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:00:38.467491 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:38.468039 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:38.474841 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:38.475296 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:38.476066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:38.476503 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:38.490580 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] HTTP exception thrown: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Request method failure captured: Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 HTTP/1.1 Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEVe-43zMedEC24gk9dDiHodLgofVqJ-VL8OuBhwyG8fI0Jd0H7TbrS9OWBanIjwu6h4bphPgWKlYUvdCytIKooRxNfUMLExgaA3pzX7u8KJ9CsfwlCnOOSDTSKw4uh5pp5iLfCf8g1Dh4Wy2_Uv5TC9GGVvemQmWacbZ-rVM6fltq0 Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:00:38.492145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11861d35a3444734be8870f47cce1b9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: b0b95c321c4a452faa81a93168c7bf0a Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.493856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '737a2c37-15f8-4f42-a879-af5af910fd30'} Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:38.494811 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.496507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.498021 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Returning 404 to user: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:38.498021 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-97192385-5f0d-4350-afab-d007f78dd566 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "DELETE /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 404 len: 111 microversion: 2.20 time: 0.030656 Jun 23 11:00:38.498021 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 512/1053] 10.222.0.39 () {60 vars in 1279 bytes} [Thu Jun 23 11:00:38 2022] DELETE /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:00:38.502199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:38.503185 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] [instance: 737a2c37-15f8-4f42-a879-af5af910fd30] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:38.509752 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:38.510202 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:38.511020 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:38.511955 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:38.526842 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] HTTP exception thrown: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Request method failure captured: Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 HTTP/1.1 Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEVe-43zMedEC24gk9dDiHodLgofVqJ-VL8OuBhwyG8fI0Jd0H7TbrS9OWBanIjwu6h4bphPgWKlYUvdCytIKooRxNfUMLExgaA3pzX7u8KJ9CsfwlCnOOSDTSKw4uh5pp5iLfCf8g1Dh4Wy2_Uv5TC9GGVvemQmWacbZ-rVM6fltq0 Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:00:38.529384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11861d35a3444734be8870f47cce1b9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11861d35a3444734be8870f47cce1b9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 11861d35a3444734be8870f47cce1b9b Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-471993149 Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: b0b95c321c4a452faa81a93168c7bf0a Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeShelveTestJSON-471993149-project Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.531119 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '737a2c37-15f8-4f42-a879-af5af910fd30'} Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:00:38.535601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. Jun 23 11:00:38.536987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:00:38.538152 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] Returning 404 to user: Instance 737a2c37-15f8-4f42-a879-af5af910fd30 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:00:38.538152 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f180b3e6-4b2e-47da-ab40-d7fef0dd1928 tempest-AttachVolumeShelveTestJSON-471993149 tempest-AttachVolumeShelveTestJSON-471993149-project] 10.222.0.39 "GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30" status: 404 len: 111 microversion: 2.20 time: 0.032480 Jun 23 11:00:38.538152 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 542/1054] 10.222.0.39 () {60 vars in 1276 bytes} [Thu Jun 23 11:00:38 2022] GET /compute/v2.1/servers/737a2c37-15f8-4f42-a879-af5af910fd30 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:00:55.180931 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8b8a0e4f-b5b7-481d-b1b8-cb26777b6f13 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:55.182041 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8b8a0e4f-b5b7-481d-b1b8-cb26777b6f13 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:55.186356 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=5 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:55.187409 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=5 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:55.192169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e4f-b5b7-481d-b1b8-cb26777b6f13 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:55.192950 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e4f-b5b7-481d-b1b8-cb26777b6f13 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:55.193842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e4f-b5b7-481d-b1b8-cb26777b6f13 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:55.194233 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e4f-b5b7-481d-b1b8-cb26777b6f13 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:55.289087 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-8b8a0e4f-b5b7-481d-b1b8-cb26777b6f13 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lazy-loading 'services' on Instance uuid a600cb79-ea27-4d68-8e08-1245e12ea0cf {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:00:55.389334 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8b8a0e4f-b5b7-481d-b1b8-cb26777b6f13 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/os-volume_attachments/b820327f-05ad-4dd2-bce7-3ce47bacd765" status: 202 len: 0 microversion: 2.1 time: 0.212667 Jun 23 11:00:55.390206 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 513/1055] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 11:00:55 2022] DELETE /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/os-volume_attachments/b820327f-05ad-4dd2-bce7-3ce47bacd765 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:00:56.528205 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b442a746-f495-40a8-8285-49b63207fbd8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:00:56.531200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:56.531974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=9 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:56.538909 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b442a746-f495-40a8-8285-49b63207fbd8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:56.539425 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b442a746-f495-40a8-8285-49b63207fbd8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:56.565588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b442a746-f495-40a8-8285-49b63207fbd8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Going to try to stop instance {{(pid=129460) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 11:00:56.623473 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b442a746-f495-40a8-8285-49b63207fbd8 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/action" status: 202 len: 0 microversion: 2.1 time: 0.100290 Jun 23 11:00:56.624069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 543/1056] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 11:00:56 2022] POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:00:56.633756 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d73b7ece-a0a4-44b2-bd68-54df4c36e0b9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:56.634476 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d73b7ece-a0a4-44b2-bd68-54df4c36e0b9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:56.642914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d73b7ece-a0a4-44b2-bd68-54df4c36e0b9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:56.643360 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d73b7ece-a0a4-44b2-bd68-54df4c36e0b9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:56.644568 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d73b7ece-a0a4-44b2-bd68-54df4c36e0b9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:56.645006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d73b7ece-a0a4-44b2-bd68-54df4c36e0b9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:56.805817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d73b7ece-a0a4-44b2-bd68-54df4c36e0b9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:56.815032 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d73b7ece-a0a4-44b2-bd68-54df4c36e0b9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.186271 Jun 23 11:00:56.815611 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 514/1057] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:56 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:00:57.834292 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2fc2a879-fbb1-449a-9457-d415bc23b548 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:57.835018 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2fc2a879-fbb1-449a-9457-d415bc23b548 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:57.841587 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2fc2a879-fbb1-449a-9457-d415bc23b548 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:57.842029 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2fc2a879-fbb1-449a-9457-d415bc23b548 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:57.842823 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2fc2a879-fbb1-449a-9457-d415bc23b548 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:57.843255 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2fc2a879-fbb1-449a-9457-d415bc23b548 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:57.984217 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2fc2a879-fbb1-449a-9457-d415bc23b548 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:57.991705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2fc2a879-fbb1-449a-9457-d415bc23b548 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.162114 Jun 23 11:00:57.992264 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 544/1058] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:57 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:00:59.009556 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1dbe13d5-f06a-4ca8-8e02-ea0423de56ef tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:59.010278 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1dbe13d5-f06a-4ca8-8e02-ea0423de56ef tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:00:59.016975 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1dbe13d5-f06a-4ca8-8e02-ea0423de56ef tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:59.017424 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1dbe13d5-f06a-4ca8-8e02-ea0423de56ef tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:59.018193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1dbe13d5-f06a-4ca8-8e02-ea0423de56ef tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:59.018660 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1dbe13d5-f06a-4ca8-8e02-ea0423de56ef tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:59.148168 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1dbe13d5-f06a-4ca8-8e02-ea0423de56ef tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:00:59.156222 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1dbe13d5-f06a-4ca8-8e02-ea0423de56ef tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.151099 Jun 23 11:00:59.156836 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 515/1059] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:00:59 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:00.174492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-673d6de7-d273-4a38-8395-2182dc23a8e3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:00.175107 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-673d6de7-d273-4a38-8395-2182dc23a8e3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:00.181886 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-673d6de7-d273-4a38-8395-2182dc23a8e3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:00.182371 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-673d6de7-d273-4a38-8395-2182dc23a8e3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:00.183841 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-673d6de7-d273-4a38-8395-2182dc23a8e3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:00.184384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-673d6de7-d273-4a38-8395-2182dc23a8e3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:00.331549 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-673d6de7-d273-4a38-8395-2182dc23a8e3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:00.339859 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-673d6de7-d273-4a38-8395-2182dc23a8e3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.169192 Jun 23 11:01:00.340438 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 545/1060] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:00 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:01.358217 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-23737a2b-ec6b-418e-920d-699e1a1f15de tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:01.364721 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-23737a2b-ec6b-418e-920d-699e1a1f15de tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:01.376962 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23737a2b-ec6b-418e-920d-699e1a1f15de tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:01.377429 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23737a2b-ec6b-418e-920d-699e1a1f15de tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:01.378177 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23737a2b-ec6b-418e-920d-699e1a1f15de tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:01.378639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-23737a2b-ec6b-418e-920d-699e1a1f15de tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:01.523947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-23737a2b-ec6b-418e-920d-699e1a1f15de tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:01.531914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-23737a2b-ec6b-418e-920d-699e1a1f15de tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.178901 Jun 23 11:01:01.532468 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 516/1061] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:01 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:02.549094 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fbb7a1fb-2eaf-4281-8231-831cba1e10a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:02.549705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fbb7a1fb-2eaf-4281-8231-831cba1e10a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:02.556567 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fbb7a1fb-2eaf-4281-8231-831cba1e10a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:02.557274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fbb7a1fb-2eaf-4281-8231-831cba1e10a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:02.558821 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fbb7a1fb-2eaf-4281-8231-831cba1e10a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:02.559273 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fbb7a1fb-2eaf-4281-8231-831cba1e10a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:02.773810 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fbb7a1fb-2eaf-4281-8231-831cba1e10a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:02.782026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fbb7a1fb-2eaf-4281-8231-831cba1e10a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.236687 Jun 23 11:01:02.782775 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 546/1062] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:02 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:03.800492 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e458b113-4950-4457-8eb0-d85d87d2658d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:03.801034 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e458b113-4950-4457-8eb0-d85d87d2658d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:03.807411 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e458b113-4950-4457-8eb0-d85d87d2658d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:03.807855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e458b113-4950-4457-8eb0-d85d87d2658d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:03.808846 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e458b113-4950-4457-8eb0-d85d87d2658d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:03.809281 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e458b113-4950-4457-8eb0-d85d87d2658d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:03.939558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e458b113-4950-4457-8eb0-d85d87d2658d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:03.947018 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e458b113-4950-4457-8eb0-d85d87d2658d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.150417 Jun 23 11:01:03.947662 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 517/1063] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:03 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:04.459785 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1370645716", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "networks": [{"uuid": "fdfc602c-1b74-4267-988a-80bd6be8c696"}]}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:01:04.512705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.network.neutron [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] validate_networks() for [('fdfc602c-1b74-4267-988a-80bd6be8c696', None, None, None, None, None)] {{(pid=129460) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:01:04.879130 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Flavor limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:01:04.879549 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Image limits 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:01:04.880014 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Flavor pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:01:04.880471 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Image pref 0:0:0 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:01:04.880868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.virt.hardware [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129460) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:01:04.890459 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:04.890919 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:04.891705 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:04.892130 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:04.908914 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Getting quotas for project 2a493f8e913a46c0bbc188ba94b91135. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:01:04.912831 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Getting quotas for user a016506e3a104467bc09926acfba95b6 and project 2a493f8e913a46c0bbc188ba94b91135. Resources: {'ram', 'instances', 'cores'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:01:04.923523 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Going to run 1 instances... {{(pid=129460) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:01:04.925721 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129460) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:01:04.965436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-54fff1e9-ea66-4d5e-b306-dd28b7bbc887 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:04.966068 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-54fff1e9-ea66-4d5e-b306-dd28b7bbc887 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:04.972974 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-54fff1e9-ea66-4d5e-b306-dd28b7bbc887 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:04.973417 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-54fff1e9-ea66-4d5e-b306-dd28b7bbc887 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:04.974183 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-54fff1e9-ea66-4d5e-b306-dd28b7bbc887 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:04.974640 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-54fff1e9-ea66-4d5e-b306-dd28b7bbc887 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:04.975996 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2008e981-64d7-486a-bed4-e83cec8e7602 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519954 Jun 23 11:01:04.976812 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 547/1064] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 11:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:01:04.987138 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-dc738472-afbd-4ee4-88b2-69fd15de145b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:04.987746 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-dc738472-afbd-4ee4-88b2-69fd15de145b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:05.068130 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dc738472-afbd-4ee4-88b2-69fd15de145b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:05.076690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-dc738472-afbd-4ee4-88b2-69fd15de145b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1219 microversion: 2.1 time: 0.092854 Jun 23 11:01:05.076934 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 548/1065] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:04 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:05.138150 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-54fff1e9-ea66-4d5e-b306-dd28b7bbc887 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:05.145733 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-54fff1e9-ea66-4d5e-b306-dd28b7bbc887 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.184138 Jun 23 11:01:05.146292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 518/1066] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:04 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:06.093388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a3f726b5-ab3f-45fe-991e-db60dd98720f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:06.094084 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a3f726b5-ab3f-45fe-991e-db60dd98720f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:06.100662 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3f726b5-ab3f-45fe-991e-db60dd98720f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:06.101106 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3f726b5-ab3f-45fe-991e-db60dd98720f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:06.101868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3f726b5-ab3f-45fe-991e-db60dd98720f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:06.102519 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a3f726b5-ab3f-45fe-991e-db60dd98720f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:06.163474 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8e2273a7-1bc0-41ed-b5fb-235ae6ed5621 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:06.164076 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8e2273a7-1bc0-41ed-b5fb-235ae6ed5621 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:06.168871 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a3f726b5-ab3f-45fe-991e-db60dd98720f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:06.171887 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8e2273a7-1bc0-41ed-b5fb-235ae6ed5621 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:06.172528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8e2273a7-1bc0-41ed-b5fb-235ae6ed5621 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:06.173534 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8e2273a7-1bc0-41ed-b5fb-235ae6ed5621 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:06.173973 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8e2273a7-1bc0-41ed-b5fb-235ae6ed5621 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:06.177220 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a3f726b5-ab3f-45fe-991e-db60dd98720f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1277 microversion: 2.1 time: 0.088101 Jun 23 11:01:06.177797 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 549/1067] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:06 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:06.329495 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-8e2273a7-1bc0-41ed-b5fb-235ae6ed5621 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:06.337171 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8e2273a7-1bc0-41ed-b5fb-235ae6ed5621 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.177764 Jun 23 11:01:06.337749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 519/1068] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:06 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:07.195362 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fc90eaa7-11dd-4b8e-891d-a056c896a341 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:07.196915 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fc90eaa7-11dd-4b8e-891d-a056c896a341 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:07.207363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc90eaa7-11dd-4b8e-891d-a056c896a341 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:07.207873 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc90eaa7-11dd-4b8e-891d-a056c896a341 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:07.208701 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc90eaa7-11dd-4b8e-891d-a056c896a341 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:07.209944 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc90eaa7-11dd-4b8e-891d-a056c896a341 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:07.354043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-02ebaf02-41da-4a6a-b330-c0f7ec38e4f4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:07.356165 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-02ebaf02-41da-4a6a-b330-c0f7ec38e4f4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:07.361417 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fc90eaa7-11dd-4b8e-891d-a056c896a341 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:07.362987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02ebaf02-41da-4a6a-b330-c0f7ec38e4f4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:07.363434 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02ebaf02-41da-4a6a-b330-c0f7ec38e4f4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:07.364202 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02ebaf02-41da-4a6a-b330-c0f7ec38e4f4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:07.364631 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02ebaf02-41da-4a6a-b330-c0f7ec38e4f4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:07.378570 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fc90eaa7-11dd-4b8e-891d-a056c896a341 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.187096 Jun 23 11:01:07.380062 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 550/1069] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:07 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:07.498670 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-02ebaf02-41da-4a6a-b330-c0f7ec38e4f4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:07.506474 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-02ebaf02-41da-4a6a-b330-c0f7ec38e4f4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.156487 Jun 23 11:01:07.507113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 520/1070] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:07 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:07.600312 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-51864a01-cc28-4129-b7a5-c3606b4d42d5 req-96ddef7b-09cb-4a8a-ba81-a2fe398e263c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744f5654-f722-4d47-8a43-47e36916ccdb", "tag": "6b5bde2c-7a07-4852-a1d2-e8881fbaba8d"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:01:07.609100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-51864a01-cc28-4129-b7a5-c3606b4d42d5 req-96ddef7b-09cb-4a8a-ba81-a2fe398e263c service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:07.609613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-51864a01-cc28-4129-b7a5-c3606b4d42d5 req-96ddef7b-09cb-4a8a-ba81-a2fe398e263c service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:07.621891 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-51864a01-cc28-4129-b7a5-c3606b4d42d5 req-96ddef7b-09cb-4a8a-ba81-a2fe398e263c service nova] Creating event network-changed:6b5bde2c-7a07-4852-a1d2-e8881fbaba8d for instance 744f5654-f722-4d47-8a43-47e36916ccdb on hv-cinder-84614 Jun 23 11:01:07.626516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-51864a01-cc28-4129-b7a5-c3606b4d42d5 req-96ddef7b-09cb-4a8a-ba81-a2fe398e263c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029897 Jun 23 11:01:07.627100 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 551/1071] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:01:08.397006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-14d46c29-b0ce-47d8-8060-7f426e85c855 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:08.397607 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-14d46c29-b0ce-47d8-8060-7f426e85c855 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:08.404508 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14d46c29-b0ce-47d8-8060-7f426e85c855 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:08.404947 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14d46c29-b0ce-47d8-8060-7f426e85c855 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:08.405692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14d46c29-b0ce-47d8-8060-7f426e85c855 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:08.406119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-14d46c29-b0ce-47d8-8060-7f426e85c855 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:08.525509 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0a6a31d8-2eb6-41df-aaf9-3c9317568dc3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:08.526259 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0a6a31d8-2eb6-41df-aaf9-3c9317568dc3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:08.533404 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0a6a31d8-2eb6-41df-aaf9-3c9317568dc3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:08.533851 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0a6a31d8-2eb6-41df-aaf9-3c9317568dc3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:08.534650 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0a6a31d8-2eb6-41df-aaf9-3c9317568dc3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:08.535086 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0a6a31d8-2eb6-41df-aaf9-3c9317568dc3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:08.536025 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-14d46c29-b0ce-47d8-8060-7f426e85c855 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:08.544030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-14d46c29-b0ce-47d8-8060-7f426e85c855 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.150877 Jun 23 11:01:08.544600 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 521/1072] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:08 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:08.668736 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0a6a31d8-2eb6-41df-aaf9-3c9317568dc3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:08.678972 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0a6a31d8-2eb6-41df-aaf9-3c9317568dc3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.157290 Jun 23 11:01:08.679562 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 552/1073] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:08 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:09.560209 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e8a4e078-a35a-4182-b69d-66f5b03ede41 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:09.560821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e8a4e078-a35a-4182-b69d-66f5b03ede41 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:09.567251 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e8a4e078-a35a-4182-b69d-66f5b03ede41 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:09.567696 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e8a4e078-a35a-4182-b69d-66f5b03ede41 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:09.568455 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e8a4e078-a35a-4182-b69d-66f5b03ede41 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:09.568888 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e8a4e078-a35a-4182-b69d-66f5b03ede41 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:09.696918 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f6d040ed-3858-4e0d-9875-648ff7f24028 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:09.697521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f6d040ed-3858-4e0d-9875-648ff7f24028 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:09.699250 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e8a4e078-a35a-4182-b69d-66f5b03ede41 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:09.704832 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6d040ed-3858-4e0d-9875-648ff7f24028 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:09.705274 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6d040ed-3858-4e0d-9875-648ff7f24028 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:09.706031 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6d040ed-3858-4e0d-9875-648ff7f24028 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:09.706492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6d040ed-3858-4e0d-9875-648ff7f24028 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:09.707078 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e8a4e078-a35a-4182-b69d-66f5b03ede41 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.150844 Jun 23 11:01:09.707645 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 522/1074] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:09 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:09.834767 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f6d040ed-3858-4e0d-9875-648ff7f24028 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:09.844728 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f6d040ed-3858-4e0d-9875-648ff7f24028 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.151297 Jun 23 11:01:09.845316 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 553/1075] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:09 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:10.724711 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-246c2e38-3aaf-4eb3-9a05-e9ba2ac742ed tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:10.725239 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-246c2e38-3aaf-4eb3-9a05-e9ba2ac742ed tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:10.731885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-246c2e38-3aaf-4eb3-9a05-e9ba2ac742ed tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:10.732323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-246c2e38-3aaf-4eb3-9a05-e9ba2ac742ed tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:10.733079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-246c2e38-3aaf-4eb3-9a05-e9ba2ac742ed tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:10.733510 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-246c2e38-3aaf-4eb3-9a05-e9ba2ac742ed tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:10.861770 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-dc02febf-b2be-4f1c-93e6-15d67e534fe6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:10.862403 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-dc02febf-b2be-4f1c-93e6-15d67e534fe6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:10.862747 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-246c2e38-3aaf-4eb3-9a05-e9ba2ac742ed tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:10.868905 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc02febf-b2be-4f1c-93e6-15d67e534fe6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:10.869359 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc02febf-b2be-4f1c-93e6-15d67e534fe6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:10.870654 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc02febf-b2be-4f1c-93e6-15d67e534fe6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:10.870774 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-246c2e38-3aaf-4eb3-9a05-e9ba2ac742ed tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.149957 Jun 23 11:01:10.871666 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 523/1076] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:10 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:10.871958 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-dc02febf-b2be-4f1c-93e6-15d67e534fe6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:11.005254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-dc02febf-b2be-4f1c-93e6-15d67e534fe6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:11.013001 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-dc02febf-b2be-4f1c-93e6-15d67e534fe6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.155063 Jun 23 11:01:11.013555 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 554/1077] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:10 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:11.888471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f288e74f-b0b6-45e3-8365-69948d09b031 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:11.889025 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f288e74f-b0b6-45e3-8365-69948d09b031 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:11.895426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f288e74f-b0b6-45e3-8365-69948d09b031 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:11.895864 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f288e74f-b0b6-45e3-8365-69948d09b031 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:11.896632 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f288e74f-b0b6-45e3-8365-69948d09b031 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:11.897380 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f288e74f-b0b6-45e3-8365-69948d09b031 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:12.030271 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-51e129c2-ac06-4bdd-b5c0-9f4bb8f11300 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:12.030912 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-51e129c2-ac06-4bdd-b5c0-9f4bb8f11300 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:12.031498 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f288e74f-b0b6-45e3-8365-69948d09b031 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:12.037166 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-51e129c2-ac06-4bdd-b5c0-9f4bb8f11300 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:12.037951 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-51e129c2-ac06-4bdd-b5c0-9f4bb8f11300 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:12.039102 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f288e74f-b0b6-45e3-8365-69948d09b031 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.155148 Jun 23 11:01:12.039788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-51e129c2-ac06-4bdd-b5c0-9f4bb8f11300 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:12.040447 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-51e129c2-ac06-4bdd-b5c0-9f4bb8f11300 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:12.050453 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 524/1078] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:11 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:12.178631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-51e129c2-ac06-4bdd-b5c0-9f4bb8f11300 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:12.186815 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-51e129c2-ac06-4bdd-b5c0-9f4bb8f11300 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.161721 Jun 23 11:01:12.187371 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 555/1079] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:12 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:13.057339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9b4b1e1e-bbf2-4c6f-a917-239231486779 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:13.058566 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9b4b1e1e-bbf2-4c6f-a917-239231486779 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:13.065015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9b4b1e1e-bbf2-4c6f-a917-239231486779 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:13.065465 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9b4b1e1e-bbf2-4c6f-a917-239231486779 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:13.066227 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9b4b1e1e-bbf2-4c6f-a917-239231486779 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:13.066688 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9b4b1e1e-bbf2-4c6f-a917-239231486779 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:13.194238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9b4b1e1e-bbf2-4c6f-a917-239231486779 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:13.202100 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9b4b1e1e-bbf2-4c6f-a917-239231486779 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.148615 Jun 23 11:01:13.202694 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 525/1080] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:13 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:13.204675 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-07362546-a058-48e2-9264-e492c47c68fa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:13.205288 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-07362546-a058-48e2-9264-e492c47c68fa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:13.211710 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-07362546-a058-48e2-9264-e492c47c68fa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:13.212157 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-07362546-a058-48e2-9264-e492c47c68fa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:13.212916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-07362546-a058-48e2-9264-e492c47c68fa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:13.213347 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-07362546-a058-48e2-9264-e492c47c68fa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:13.343713 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-07362546-a058-48e2-9264-e492c47c68fa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:13.351277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-07362546-a058-48e2-9264-e492c47c68fa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.150657 Jun 23 11:01:13.351845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 556/1081] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:13 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:14.219162 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1044e0b1-7b43-461f-af7a-e722c20ba2e4 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:14.219785 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1044e0b1-7b43-461f-af7a-e722c20ba2e4 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:14.226139 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1044e0b1-7b43-461f-af7a-e722c20ba2e4 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:14.226617 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1044e0b1-7b43-461f-af7a-e722c20ba2e4 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:14.227366 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1044e0b1-7b43-461f-af7a-e722c20ba2e4 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:14.227793 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1044e0b1-7b43-461f-af7a-e722c20ba2e4 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:14.360816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1044e0b1-7b43-461f-af7a-e722c20ba2e4 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:14.368859 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1044e0b1-7b43-461f-af7a-e722c20ba2e4 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.153576 Jun 23 11:01:14.369086 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ca761615-c548-454f-a052-b37a715aab7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:14.369754 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ca761615-c548-454f-a052-b37a715aab7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:14.370029 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 526/1082] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:14 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:14.377403 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ca761615-c548-454f-a052-b37a715aab7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:14.377853 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ca761615-c548-454f-a052-b37a715aab7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:14.378653 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ca761615-c548-454f-a052-b37a715aab7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:14.379090 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ca761615-c548-454f-a052-b37a715aab7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:14.509321 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ca761615-c548-454f-a052-b37a715aab7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:14.516776 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ca761615-c548-454f-a052-b37a715aab7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.151774 Jun 23 11:01:14.517344 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 557/1083] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:14 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:15.388002 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7ea55d30-6349-422c-bc30-2fdbacd553fd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:15.388567 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7ea55d30-6349-422c-bc30-2fdbacd553fd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:15.395039 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7ea55d30-6349-422c-bc30-2fdbacd553fd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:15.395487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7ea55d30-6349-422c-bc30-2fdbacd553fd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:15.396244 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7ea55d30-6349-422c-bc30-2fdbacd553fd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:15.396674 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7ea55d30-6349-422c-bc30-2fdbacd553fd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:15.527404 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7ea55d30-6349-422c-bc30-2fdbacd553fd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:15.529870 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:15.530879 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=8 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:15.535479 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7ea55d30-6349-422c-bc30-2fdbacd553fd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.152007 Jun 23 11:01:15.535706 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d4882788-5159-43f7-be0c-f83c7e34510f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:15.536361 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 527/1084] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:15 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:15.536863 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d4882788-5159-43f7-be0c-f83c7e34510f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:15.544818 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d4882788-5159-43f7-be0c-f83c7e34510f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:15.545275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d4882788-5159-43f7-be0c-f83c7e34510f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:15.546049 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d4882788-5159-43f7-be0c-f83c7e34510f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:15.546510 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d4882788-5159-43f7-be0c-f83c7e34510f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:15.674697 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d4882788-5159-43f7-be0c-f83c7e34510f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:15.682024 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d4882788-5159-43f7-be0c-f83c7e34510f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.152982 Jun 23 11:01:15.683727 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 558/1085] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:15 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:16.551781 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e7d3bebf-1076-40ec-86c5-5e3ea5e5479c tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:16.552381 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e7d3bebf-1076-40ec-86c5-5e3ea5e5479c tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:16.559616 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e7d3bebf-1076-40ec-86c5-5e3ea5e5479c tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:16.560050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e7d3bebf-1076-40ec-86c5-5e3ea5e5479c tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:16.560802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e7d3bebf-1076-40ec-86c5-5e3ea5e5479c tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:16.561226 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e7d3bebf-1076-40ec-86c5-5e3ea5e5479c tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:16.691802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e7d3bebf-1076-40ec-86c5-5e3ea5e5479c tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:16.695468 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:16.699051 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-de6cd3cb-32f2-4855-a74c-cba16430a0f7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:16.699665 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-de6cd3cb-32f2-4855-a74c-cba16430a0f7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:16.700738 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e7d3bebf-1076-40ec-86c5-5e3ea5e5479c tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.152770 Jun 23 11:01:16.701314 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 528/1086] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:16 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:16.706420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-de6cd3cb-32f2-4855-a74c-cba16430a0f7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:16.706872 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-de6cd3cb-32f2-4855-a74c-cba16430a0f7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:16.707637 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-de6cd3cb-32f2-4855-a74c-cba16430a0f7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:16.708071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-de6cd3cb-32f2-4855-a74c-cba16430a0f7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:16.840299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-de6cd3cb-32f2-4855-a74c-cba16430a0f7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:16.847695 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-de6cd3cb-32f2-4855-a74c-cba16430a0f7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.153017 Jun 23 11:01:16.848255 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 559/1087] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:16 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:17.718270 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e2cb7b75-6781-4d7f-ad78-1a8e4bb49093 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:17.719077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e2cb7b75-6781-4d7f-ad78-1a8e4bb49093 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:17.726775 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e2cb7b75-6781-4d7f-ad78-1a8e4bb49093 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:17.727219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e2cb7b75-6781-4d7f-ad78-1a8e4bb49093 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:17.727987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e2cb7b75-6781-4d7f-ad78-1a8e4bb49093 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:17.728419 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e2cb7b75-6781-4d7f-ad78-1a8e4bb49093 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:17.865161 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-065f1ca7-a3a3-4e7a-ada3-48b87ed03c83 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:17.865856 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-065f1ca7-a3a3-4e7a-ada3-48b87ed03c83 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:17.867855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e2cb7b75-6781-4d7f-ad78-1a8e4bb49093 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:17.873516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-065f1ca7-a3a3-4e7a-ada3-48b87ed03c83 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:17.874046 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-065f1ca7-a3a3-4e7a-ada3-48b87ed03c83 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:17.874923 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-065f1ca7-a3a3-4e7a-ada3-48b87ed03c83 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:17.875517 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-065f1ca7-a3a3-4e7a-ada3-48b87ed03c83 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:17.876375 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e2cb7b75-6781-4d7f-ad78-1a8e4bb49093 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.162756 Jun 23 11:01:17.877164 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 529/1088] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:17 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:18.008238 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-065f1ca7-a3a3-4e7a-ada3-48b87ed03c83 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:18.011760 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:18.016516 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-065f1ca7-a3a3-4e7a-ada3-48b87ed03c83 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1679 microversion: 2.1 time: 0.155238 Jun 23 11:01:18.017090 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 560/1089] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:17 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:18.893269 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-0c8c8709-de18-4ed6-ab2f-547152ebf539 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:18.893886 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-0c8c8709-de18-4ed6-ab2f-547152ebf539 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:18.900671 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0c8c8709-de18-4ed6-ab2f-547152ebf539 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:18.901221 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0c8c8709-de18-4ed6-ab2f-547152ebf539 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:18.901875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0c8c8709-de18-4ed6-ab2f-547152ebf539 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:18.902303 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-0c8c8709-de18-4ed6-ab2f-547152ebf539 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:19.033927 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-01431c1c-7e67-4a68-b8a7-2896d65e7e2f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:19.034620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-01431c1c-7e67-4a68-b8a7-2896d65e7e2f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:19.041573 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-01431c1c-7e67-4a68-b8a7-2896d65e7e2f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:19.043210 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-01431c1c-7e67-4a68-b8a7-2896d65e7e2f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:19.043997 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-01431c1c-7e67-4a68-b8a7-2896d65e7e2f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:19.044425 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-01431c1c-7e67-4a68-b8a7-2896d65e7e2f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:19.056639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-0c8c8709-de18-4ed6-ab2f-547152ebf539 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:19.065866 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-0c8c8709-de18-4ed6-ab2f-547152ebf539 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.176144 Jun 23 11:01:19.077286 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 530/1090] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:18 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:19.200349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-01431c1c-7e67-4a68-b8a7-2896d65e7e2f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:19.208538 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-01431c1c-7e67-4a68-b8a7-2896d65e7e2f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1656 microversion: 2.1 time: 0.178818 Jun 23 11:01:19.209198 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 561/1091] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:19 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1656 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:19.226252 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-86d09d4c-8a2c-4cc4-810f-f519fd4e8264 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:01:19.233354 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86d09d4c-8a2c-4cc4-810f-f519fd4e8264 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:19.233919 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-86d09d4c-8a2c-4cc4-810f-f519fd4e8264 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:19.258203 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-86d09d4c-8a2c-4cc4-810f-f519fd4e8264 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Going to try to start instance {{(pid=129461) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 11:01:19.302884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-86d09d4c-8a2c-4cc4-810f-f519fd4e8264 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/action" status: 202 len: 0 microversion: 2.1 time: 0.080632 Jun 23 11:01:19.303775 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 531/1092] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 11:01:19 2022] POST /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:01:19.312135 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f9e298cd-7701-4e56-95ac-996a0e6f614f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:19.312744 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f9e298cd-7701-4e56-95ac-996a0e6f614f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:19.318818 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9e298cd-7701-4e56-95ac-996a0e6f614f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:19.319262 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9e298cd-7701-4e56-95ac-996a0e6f614f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:19.320044 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9e298cd-7701-4e56-95ac-996a0e6f614f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:19.320476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9e298cd-7701-4e56-95ac-996a0e6f614f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:19.466033 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f9e298cd-7701-4e56-95ac-996a0e6f614f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:19.473896 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f9e298cd-7701-4e56-95ac-996a0e6f614f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1665 microversion: 2.1 time: 0.166082 Jun 23 11:01:19.474504 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 562/1093] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:19 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1665 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:20.085043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-32e45840-82ec-49d2-b06d-ff6475a749ca tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:20.090872 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-32e45840-82ec-49d2-b06d-ff6475a749ca tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:20.097323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-32e45840-82ec-49d2-b06d-ff6475a749ca tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:20.097802 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-32e45840-82ec-49d2-b06d-ff6475a749ca tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:20.098598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-32e45840-82ec-49d2-b06d-ff6475a749ca tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:20.099030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-32e45840-82ec-49d2-b06d-ff6475a749ca tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:20.233543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-32e45840-82ec-49d2-b06d-ff6475a749ca tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:20.241460 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-32e45840-82ec-49d2-b06d-ff6475a749ca tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.161318 Jun 23 11:01:20.242028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 532/1094] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:20 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:20.495439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-740af3d0-5758-47e2-932b-2e6cf0315647 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:20.496336 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-740af3d0-5758-47e2-932b-2e6cf0315647 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:20.505239 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-740af3d0-5758-47e2-932b-2e6cf0315647 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:20.505852 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-740af3d0-5758-47e2-932b-2e6cf0315647 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:20.506977 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-740af3d0-5758-47e2-932b-2e6cf0315647 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:20.507951 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-740af3d0-5758-47e2-932b-2e6cf0315647 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:20.672984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-740af3d0-5758-47e2-932b-2e6cf0315647 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:20.680476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-740af3d0-5758-47e2-932b-2e6cf0315647 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1669 microversion: 2.1 time: 0.191447 Jun 23 11:01:20.681036 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 563/1095] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:20 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1669 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:01:21.258967 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4a8f1a7d-1f0c-4ebd-bf6a-b6b78a65e24b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:21.259494 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4a8f1a7d-1f0c-4ebd-bf6a-b6b78a65e24b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:21.265914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a8f1a7d-1f0c-4ebd-bf6a-b6b78a65e24b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:21.266374 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a8f1a7d-1f0c-4ebd-bf6a-b6b78a65e24b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:21.267128 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a8f1a7d-1f0c-4ebd-bf6a-b6b78a65e24b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:21.267550 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4a8f1a7d-1f0c-4ebd-bf6a-b6b78a65e24b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:21.397891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4a8f1a7d-1f0c-4ebd-bf6a-b6b78a65e24b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:21.405952 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4a8f1a7d-1f0c-4ebd-bf6a-b6b78a65e24b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.150965 Jun 23 11:01:21.406540 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 533/1096] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:21 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:22.021229 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-f95968f9-09b9-46a1-be3e-45f50c0f3a03 req-c21fb2c4-1958-4131-a7fe-96a545cdb791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744f5654-f722-4d47-8a43-47e36916ccdb", "name": "network-vif-plugged", "status": "completed", "tag": "6b5bde2c-7a07-4852-a1d2-e8881fbaba8d"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:01:22.031302 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-f95968f9-09b9-46a1-be3e-45f50c0f3a03 req-c21fb2c4-1958-4131-a7fe-96a545cdb791 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:22.031750 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-f95968f9-09b9-46a1-be3e-45f50c0f3a03 req-c21fb2c4-1958-4131-a7fe-96a545cdb791 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:22.043321 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-f95968f9-09b9-46a1-be3e-45f50c0f3a03 req-c21fb2c4-1958-4131-a7fe-96a545cdb791 service nova] Creating event network-vif-plugged:6b5bde2c-7a07-4852-a1d2-e8881fbaba8d for instance 744f5654-f722-4d47-8a43-47e36916ccdb on hv-cinder-84614 Jun 23 11:01:22.048327 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-f95968f9-09b9-46a1-be3e-45f50c0f3a03 req-c21fb2c4-1958-4131-a7fe-96a545cdb791 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031032 Jun 23 11:01:22.049168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 564/1097] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:01:22.423641 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-49a26d43-bea6-4dbe-970c-899070abec8e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:22.424189 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-49a26d43-bea6-4dbe-970c-899070abec8e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:22.430703 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-49a26d43-bea6-4dbe-970c-899070abec8e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:22.431147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-49a26d43-bea6-4dbe-970c-899070abec8e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:22.431891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-49a26d43-bea6-4dbe-970c-899070abec8e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:22.432313 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-49a26d43-bea6-4dbe-970c-899070abec8e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:22.564919 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-49a26d43-bea6-4dbe-970c-899070abec8e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:22.572348 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-49a26d43-bea6-4dbe-970c-899070abec8e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.152614 Jun 23 11:01:22.572912 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 534/1098] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:22 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:23.590561 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bc7cd373-aeaa-4ef4-b93f-4d587e72b919 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:23.591259 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bc7cd373-aeaa-4ef4-b93f-4d587e72b919 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:23.597440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc7cd373-aeaa-4ef4-b93f-4d587e72b919 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:23.597887 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc7cd373-aeaa-4ef4-b93f-4d587e72b919 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:23.598701 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc7cd373-aeaa-4ef4-b93f-4d587e72b919 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:23.599139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc7cd373-aeaa-4ef4-b93f-4d587e72b919 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:23.727861 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bc7cd373-aeaa-4ef4-b93f-4d587e72b919 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:23.735224 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bc7cd373-aeaa-4ef4-b93f-4d587e72b919 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.149932 Jun 23 11:01:23.735776 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 565/1099] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:23 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:24.752000 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c61f3b83-79ea-4d19-9777-44a0984cae98 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:24.752608 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c61f3b83-79ea-4d19-9777-44a0984cae98 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:24.759136 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c61f3b83-79ea-4d19-9777-44a0984cae98 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:24.759597 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c61f3b83-79ea-4d19-9777-44a0984cae98 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:24.760363 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c61f3b83-79ea-4d19-9777-44a0984cae98 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:24.760798 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c61f3b83-79ea-4d19-9777-44a0984cae98 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:24.892235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c61f3b83-79ea-4d19-9777-44a0984cae98 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:24.899569 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c61f3b83-79ea-4d19-9777-44a0984cae98 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.151456 Jun 23 11:01:24.900123 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 535/1100] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:24 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:25.916254 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a4ed8e50-0198-40b1-8817-d0bf147c82a8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:25.916886 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a4ed8e50-0198-40b1-8817-d0bf147c82a8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:25.924291 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a4ed8e50-0198-40b1-8817-d0bf147c82a8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:25.924730 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a4ed8e50-0198-40b1-8817-d0bf147c82a8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:25.925478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a4ed8e50-0198-40b1-8817-d0bf147c82a8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:25.925909 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a4ed8e50-0198-40b1-8817-d0bf147c82a8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:26.054582 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a4ed8e50-0198-40b1-8817-d0bf147c82a8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:26.062632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a4ed8e50-0198-40b1-8817-d0bf147c82a8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.150093 Jun 23 11:01:26.063212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 566/1101] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:25 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:27.079846 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4df76020-343c-4db3-9fda-7a533fbf62c1 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:27.080435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4df76020-343c-4db3-9fda-7a533fbf62c1 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:27.082993 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=47 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:27.088645 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4df76020-343c-4db3-9fda-7a533fbf62c1 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:27.089088 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4df76020-343c-4db3-9fda-7a533fbf62c1 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:27.089920 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4df76020-343c-4db3-9fda-7a533fbf62c1 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:27.090391 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4df76020-343c-4db3-9fda-7a533fbf62c1 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:27.222446 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4df76020-343c-4db3-9fda-7a533fbf62c1 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:27.229707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4df76020-343c-4db3-9fda-7a533fbf62c1 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1319 microversion: 2.1 time: 0.154062 Jun 23 11:01:27.230887 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 536/1102] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:27 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:28.248677 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-24cb8449-c930-4daf-9bd2-f33bd13d08b8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:28.249335 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-24cb8449-c930-4daf-9bd2-f33bd13d08b8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:28.251782 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:28.257115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-24cb8449-c930-4daf-9bd2-f33bd13d08b8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:28.257564 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-24cb8449-c930-4daf-9bd2-f33bd13d08b8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:28.258338 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-24cb8449-c930-4daf-9bd2-f33bd13d08b8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:28.258777 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-24cb8449-c930-4daf-9bd2-f33bd13d08b8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:28.389779 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-24cb8449-c930-4daf-9bd2-f33bd13d08b8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:01:28.397289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-24cb8449-c930-4daf-9bd2-f33bd13d08b8 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1509 microversion: 2.1 time: 0.154095 Jun 23 11:01:28.397848 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 567/1103] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:28 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:01:57.204070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f82e19ac-c56a-41c1-8394-7f6d1690c452 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9d42e30-f228-49d5-8e66-c5536f4c5885", "device": "/dev/sdb"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:01:57.205698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f82e19ac-c56a-41c1-8394-7f6d1690c452 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:57.207825 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:57.208488 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:57.214370 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f82e19ac-c56a-41c1-8394-7f6d1690c452 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:57.214816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f82e19ac-c56a-41c1-8394-7f6d1690c452 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:57.215579 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f82e19ac-c56a-41c1-8394-7f6d1690c452 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:57.216016 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f82e19ac-c56a-41c1-8394-7f6d1690c452 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:57.467622 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f82e19ac-c56a-41c1-8394-7f6d1690c452 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "POST /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267770 Jun 23 11:01:57.468249 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 537/1104] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 11:01:57 2022] POST /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:01:59.650714 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-83964fad-8f45-4e84-87fe-6372dc1d883e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:59.651236 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-83964fad-8f45-4e84-87fe-6372dc1d883e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:59.658299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:59.661117 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=38 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:59.664192 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-83964fad-8f45-4e84-87fe-6372dc1d883e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:59.664922 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-83964fad-8f45-4e84-87fe-6372dc1d883e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:59.665714 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-83964fad-8f45-4e84-87fe-6372dc1d883e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:59.666307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-83964fad-8f45-4e84-87fe-6372dc1d883e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:59.698841 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-83964fad-8f45-4e84-87fe-6372dc1d883e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:01:59.820982 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-83964fad-8f45-4e84-87fe-6372dc1d883e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 204 len: 0 microversion: 2.1 time: 0.174265 Jun 23 11:01:59.825488 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 568/1105] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:01:59 2022] DELETE /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:01:59.832508 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8a7e71fa-f5d1-4aac-9c39-28a0e2e195c4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:59.833258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8a7e71fa-f5d1-4aac-9c39-28a0e2e195c4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:01:59.840006 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8a7e71fa-f5d1-4aac-9c39-28a0e2e195c4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:59.840710 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8a7e71fa-f5d1-4aac-9c39-28a0e2e195c4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:59.841642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8a7e71fa-f5d1-4aac-9c39-28a0e2e195c4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:59.842370 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8a7e71fa-f5d1-4aac-9c39-28a0e2e195c4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:59.849578 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-5e45e9c6-7562-48e4-8d66-e657da3b298b req-24a848fc-4ee0-431b-b689-e2c6b070b0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc479a7-01a4-4542-ba20-fb9940274d47", "tag": "d0280365-24f6-4acb-be5d-6150915fc998"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:01:59.860273 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-5e45e9c6-7562-48e4-8d66-e657da3b298b req-24a848fc-4ee0-431b-b689-e2c6b070b0d3 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:59.862578 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-5e45e9c6-7562-48e4-8d66-e657da3b298b req-24a848fc-4ee0-431b-b689-e2c6b070b0d3 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:59.877996 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-5e45e9c6-7562-48e4-8d66-e657da3b298b req-24a848fc-4ee0-431b-b689-e2c6b070b0d3 service nova] Creating event network-changed:d0280365-24f6-4acb-be5d-6150915fc998 for instance 6bc479a7-01a4-4542-ba20-fb9940274d47 on hv-cinder-84614 Jun 23 11:01:59.883894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-5e45e9c6-7562-48e4-8d66-e657da3b298b req-24a848fc-4ee0-431b-b689-e2c6b070b0d3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219467 Jun 23 11:01:59.885165 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 538/1106] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:02:00.011428 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8a7e71fa-f5d1-4aac-9c39-28a0e2e195c4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:00.020514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8a7e71fa-f5d1-4aac-9c39-28a0e2e195c4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1578 microversion: 2.1 time: 0.193626 Jun 23 11:02:00.021180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 569/1107] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:01:59 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1578 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:01.039721 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7955e831-f082-409f-9c81-c42015813473 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:01.040564 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7955e831-f082-409f-9c81-c42015813473 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:01.047110 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7955e831-f082-409f-9c81-c42015813473 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:01.047552 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7955e831-f082-409f-9c81-c42015813473 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:01.049016 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7955e831-f082-409f-9c81-c42015813473 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:01.050043 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7955e831-f082-409f-9c81-c42015813473 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:01.257884 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7955e831-f082-409f-9c81-c42015813473 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:01.269272 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7955e831-f082-409f-9c81-c42015813473 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1578 microversion: 2.1 time: 0.234153 Jun 23 11:02:01.280339 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 539/1108] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:01 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:02.311073 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2a0a8791-8e87-4d39-85cf-53a9ba403aa0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:02.311905 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2a0a8791-8e87-4d39-85cf-53a9ba403aa0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:02.325453 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a0a8791-8e87-4d39-85cf-53a9ba403aa0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:02.326085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a0a8791-8e87-4d39-85cf-53a9ba403aa0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:02.327337 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a0a8791-8e87-4d39-85cf-53a9ba403aa0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:02.327926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a0a8791-8e87-4d39-85cf-53a9ba403aa0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:02.410956 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2a0a8791-8e87-4d39-85cf-53a9ba403aa0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:02.420656 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2a0a8791-8e87-4d39-85cf-53a9ba403aa0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1391 microversion: 2.1 time: 0.136683 Jun 23 11:02:02.422302 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 570/1109] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:02 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1391 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:02.582598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-ba577a46-26a5-467f-8435-dc893630ecc2 req-7e7c4b4c-4ab3-4393-a1ef-60ff3862972c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc479a7-01a4-4542-ba20-fb9940274d47", "name": "network-vif-deleted", "tag": "d0280365-24f6-4acb-be5d-6150915fc998"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:02.591167 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-ba577a46-26a5-467f-8435-dc893630ecc2 req-7e7c4b4c-4ab3-4393-a1ef-60ff3862972c service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:02.591607 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-ba577a46-26a5-467f-8435-dc893630ecc2 req-7e7c4b4c-4ab3-4393-a1ef-60ff3862972c service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:02.607691 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-ba577a46-26a5-467f-8435-dc893630ecc2 req-7e7c4b4c-4ab3-4393-a1ef-60ff3862972c service nova] Creating event network-vif-deleted:d0280365-24f6-4acb-be5d-6150915fc998 for instance 6bc479a7-01a4-4542-ba20-fb9940274d47 on hv-cinder-84614 Jun 23 11:02:02.616635 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-ba577a46-26a5-467f-8435-dc893630ecc2 req-7e7c4b4c-4ab3-4393-a1ef-60ff3862972c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288243 Jun 23 11:02:02.617472 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 540/1110] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:02:03.438514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:03.439898 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:03.446626 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:03.447069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:03.447831 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:03.448262 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:03.481339 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:03.481779 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:03.482344 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lazy-loading 'fault' on Instance uuid 6bc479a7-01a4-4542-ba20-fb9940274d47 {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:02:03.537086 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:03.549266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0aba7146-ef58-44a3-9695-4d17c9dc116f tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 200 len: 1230 microversion: 2.1 time: 0.114325 Jun 23 11:02:03.550172 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 571/1111] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:03 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 1230 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:04.574797 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:04.575500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: 6bc479a7-01a4-4542-ba20-fb9940274d47] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:04.583530 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:04.583970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:04.584743 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:04.585170 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:04.600316 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] HTTP exception thrown: Instance 6bc479a7-01a4-4542-ba20-fb9940274d47 could not be found. Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Request method failure captured: Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 HTTP/1.1 Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEYNPhIHNrta-Ij_Wdy6in3BCJEwZbBcIb35A35e7f2Ydi1faIUvhInEo139qko6k2KU3Pte0GliMJhDTlfEowCqoPt7J83Hiiq4DAvuduVx5U-Jiew37nQbogcLdJCL1awC3QFEStG4F0ZkTmZj5r_Uqv-9cg4h5OgxQLysLtqoQ0I Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:02:04.601981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_79dbb107721b4406b5c3e2f5081034fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-TestVolumeBootPattern-402649719-project Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: 10ae039c34c442f880c51aaf9024db8d Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-TestVolumeBootPattern-402649719-project Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 6bc479a7-01a4-4542-ba20-fb9940274d47 could not be found. Jun 23 11:02:04.603779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '6bc479a7-01a4-4542-ba20-fb9940274d47'} Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc479a7-01a4-4542-ba20-fb9940274d47 could not be found. Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:02:04.604749 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc479a7-01a4-4542-ba20-fb9940274d47 could not be found. Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc479a7-01a4-4542-ba20-fb9940274d47 could not be found. Jun 23 11:02:04.606346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:04.607835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Returning 404 to user: Instance 6bc479a7-01a4-4542-ba20-fb9940274d47 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:02:04.607835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7042a65c-2e6f-4e3b-a29e-ac9474c5fcd7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47" status: 404 len: 111 microversion: 2.1 time: 0.033688 Jun 23 11:02:04.607835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 541/1112] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:04 2022] GET /compute/v2.1/servers/6bc479a7-01a4-4542-ba20-fb9940274d47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:02:13.227657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e5f9c6c3-3099-4c56-b2fb-466911367b47 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:13.228919 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e5f9c6c3-3099-4c56-b2fb-466911367b47 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:13.236029 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e5f9c6c3-3099-4c56-b2fb-466911367b47 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:13.236888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e5f9c6c3-3099-4c56-b2fb-466911367b47 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:13.237805 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e5f9c6c3-3099-4c56-b2fb-466911367b47 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:13.237935 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e5f9c6c3-3099-4c56-b2fb-466911367b47 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:13.244828 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-05d12f95-e204-4fe0-8115-809565e08706 req-a54b5c7c-e17c-464c-9e26-79424397113a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72946e4-9448-4001-95ad-e03543a36ac8", "tag": "e8d735e0-24ce-4fb3-99e3-2718d4a783c8"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:13.257946 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-05d12f95-e204-4fe0-8115-809565e08706 req-a54b5c7c-e17c-464c-9e26-79424397113a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:13.259719 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-05d12f95-e204-4fe0-8115-809565e08706 req-a54b5c7c-e17c-464c-9e26-79424397113a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:13.273177 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-05d12f95-e204-4fe0-8115-809565e08706 req-a54b5c7c-e17c-464c-9e26-79424397113a service nova] Creating event network-changed:e8d735e0-24ce-4fb3-99e3-2718d4a783c8 for instance f72946e4-9448-4001-95ad-e03543a36ac8 on hv-cinder-84614 Jun 23 11:02:13.280353 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-05d12f95-e204-4fe0-8115-809565e08706 req-a54b5c7c-e17c-464c-9e26-79424397113a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040258 Jun 23 11:02:13.281446 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e5f9c6c3-3099-4c56-b2fb-466911367b47 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:02:13.284588 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 542/1113] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:02:13.372674 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e5f9c6c3-3099-4c56-b2fb-466911367b47 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 204 len: 0 microversion: 2.1 time: 0.148660 Jun 23 11:02:13.374207 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 572/1114] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:02:13 2022] DELETE /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:02:13.383985 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5510b818-1f73-4e4f-8af1-5524bfa7366b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:13.384706 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5510b818-1f73-4e4f-8af1-5524bfa7366b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:13.392204 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5510b818-1f73-4e4f-8af1-5524bfa7366b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:13.393405 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5510b818-1f73-4e4f-8af1-5524bfa7366b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:13.394527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5510b818-1f73-4e4f-8af1-5524bfa7366b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:13.395168 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5510b818-1f73-4e4f-8af1-5524bfa7366b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:13.569823 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5510b818-1f73-4e4f-8af1-5524bfa7366b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:13.581658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5510b818-1f73-4e4f-8af1-5524bfa7366b tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1578 microversion: 2.1 time: 0.202199 Jun 23 11:02:13.583455 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 543/1115] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:13 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:14.601077 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-eaca1092-57bf-430d-9060-d3001374f40e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:14.601787 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-eaca1092-57bf-430d-9060-d3001374f40e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:14.608122 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-eaca1092-57bf-430d-9060-d3001374f40e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:14.608563 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-eaca1092-57bf-430d-9060-d3001374f40e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:14.609316 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-eaca1092-57bf-430d-9060-d3001374f40e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:14.609745 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-eaca1092-57bf-430d-9060-d3001374f40e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:14.753070 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-eaca1092-57bf-430d-9060-d3001374f40e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:14.764849 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-eaca1092-57bf-430d-9060-d3001374f40e tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1578 microversion: 2.1 time: 0.168643 Jun 23 11:02:14.765422 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 573/1116] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:14 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:15.783348 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c5e409c5-d000-4c8d-81b9-e0652920456a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:15.784569 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c5e409c5-d000-4c8d-81b9-e0652920456a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:15.790765 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c5e409c5-d000-4c8d-81b9-e0652920456a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:15.791147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c5e409c5-d000-4c8d-81b9-e0652920456a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:15.791916 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c5e409c5-d000-4c8d-81b9-e0652920456a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:15.792353 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c5e409c5-d000-4c8d-81b9-e0652920456a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:15.920764 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c5e409c5-d000-4c8d-81b9-e0652920456a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:15.928459 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c5e409c5-d000-4c8d-81b9-e0652920456a tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1578 microversion: 2.1 time: 0.149003 Jun 23 11:02:15.929009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 544/1117] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:15 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:16.946167 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8ea3b28b-8861-4e23-b213-977955c8f311 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:16.946981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8ea3b28b-8861-4e23-b213-977955c8f311 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:16.953898 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ea3b28b-8861-4e23-b213-977955c8f311 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:16.954640 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ea3b28b-8861-4e23-b213-977955c8f311 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:16.955911 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ea3b28b-8861-4e23-b213-977955c8f311 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:16.955911 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8ea3b28b-8861-4e23-b213-977955c8f311 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:17.094764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8ea3b28b-8861-4e23-b213-977955c8f311 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:17.102527 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8ea3b28b-8861-4e23-b213-977955c8f311 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1578 microversion: 2.1 time: 0.160343 Jun 23 11:02:17.103104 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 574/1118] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:16 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:18.119698 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c1e79419-c8c0-4407-85f9-2a018d210bf1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:18.120308 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c1e79419-c8c0-4407-85f9-2a018d210bf1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:18.126970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c1e79419-c8c0-4407-85f9-2a018d210bf1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:18.127744 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c1e79419-c8c0-4407-85f9-2a018d210bf1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:18.128207 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c1e79419-c8c0-4407-85f9-2a018d210bf1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:18.129476 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c1e79419-c8c0-4407-85f9-2a018d210bf1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:18.268763 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c1e79419-c8c0-4407-85f9-2a018d210bf1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:18.277281 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c1e79419-c8c0-4407-85f9-2a018d210bf1 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1578 microversion: 2.1 time: 0.161746 Jun 23 11:02:18.278062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 545/1119] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:18 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:18.374352 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-f98050af-8741-4f1c-9de8-52916a4e2d31 req-4ae733c7-8709-45a1-93c8-554daa1cd54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72946e4-9448-4001-95ad-e03543a36ac8", "name": "network-vif-deleted", "tag": "e8d735e0-24ce-4fb3-99e3-2718d4a783c8"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:18.383953 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-f98050af-8741-4f1c-9de8-52916a4e2d31 req-4ae733c7-8709-45a1-93c8-554daa1cd54a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:18.384393 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-f98050af-8741-4f1c-9de8-52916a4e2d31 req-4ae733c7-8709-45a1-93c8-554daa1cd54a service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:18.398244 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-f98050af-8741-4f1c-9de8-52916a4e2d31 req-4ae733c7-8709-45a1-93c8-554daa1cd54a service nova] Creating event network-vif-deleted:e8d735e0-24ce-4fb3-99e3-2718d4a783c8 for instance f72946e4-9448-4001-95ad-e03543a36ac8 on hv-cinder-84614 Jun 23 11:02:18.403750 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-f98050af-8741-4f1c-9de8-52916a4e2d31 req-4ae733c7-8709-45a1-93c8-554daa1cd54a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 Jun 23 11:02:18.404438 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 575/1120] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:19.294891 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-96904cd1-bf0b-4def-b858-d3f9fd8406ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:19.295459 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-96904cd1-bf0b-4def-b858-d3f9fd8406ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:19.302187 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96904cd1-bf0b-4def-b858-d3f9fd8406ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:19.302664 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96904cd1-bf0b-4def-b858-d3f9fd8406ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:19.303430 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96904cd1-bf0b-4def-b858-d3f9fd8406ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:19.303856 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-96904cd1-bf0b-4def-b858-d3f9fd8406ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:19.364399 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-96904cd1-bf0b-4def-b858-d3f9fd8406ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:19.371914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-96904cd1-bf0b-4def-b858-d3f9fd8406ff tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1391 microversion: 2.1 time: 0.081010 Jun 23 11:02:19.372507 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 546/1121] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:19 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1391 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:20.389697 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fb080f97-6c71-441e-9286-bbea54c35298 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:20.390412 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fb080f97-6c71-441e-9286-bbea54c35298 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:20.396786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fb080f97-6c71-441e-9286-bbea54c35298 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:20.397225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fb080f97-6c71-441e-9286-bbea54c35298 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:20.397971 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fb080f97-6c71-441e-9286-bbea54c35298 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:20.398438 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fb080f97-6c71-441e-9286-bbea54c35298 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:20.710240 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fb080f97-6c71-441e-9286-bbea54c35298 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:20.718052 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fb080f97-6c71-441e-9286-bbea54c35298 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1225 microversion: 2.1 time: 0.332921 Jun 23 11:02:20.718649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 576/1122] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:20 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1225 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:21.735987 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2d6d0a38-40cc-4a7d-937c-9d45b381afe0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:21.736593 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2d6d0a38-40cc-4a7d-937c-9d45b381afe0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:21.743151 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d6d0a38-40cc-4a7d-937c-9d45b381afe0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:21.743597 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d6d0a38-40cc-4a7d-937c-9d45b381afe0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:21.744359 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d6d0a38-40cc-4a7d-937c-9d45b381afe0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:21.744790 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2d6d0a38-40cc-4a7d-937c-9d45b381afe0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:21.811330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2d6d0a38-40cc-4a7d-937c-9d45b381afe0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:21.820092 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2d6d0a38-40cc-4a7d-937c-9d45b381afe0 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1225 microversion: 2.1 time: 0.088004 Jun 23 11:02:21.820665 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 547/1123] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:21 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:22.837940 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2c5cc420-4eb3-436e-b65a-10935aae49d4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:22.838657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2c5cc420-4eb3-436e-b65a-10935aae49d4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:22.847548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2c5cc420-4eb3-436e-b65a-10935aae49d4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:22.847986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2c5cc420-4eb3-436e-b65a-10935aae49d4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:22.848749 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2c5cc420-4eb3-436e-b65a-10935aae49d4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:22.849180 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2c5cc420-4eb3-436e-b65a-10935aae49d4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:22.913476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2c5cc420-4eb3-436e-b65a-10935aae49d4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:22.921802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2c5cc420-4eb3-436e-b65a-10935aae49d4 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1225 microversion: 2.1 time: 0.088809 Jun 23 11:02:22.922690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 577/1124] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:22 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:23.939364 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:23.949096 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:23.961944 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:23.962498 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:23.963814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:23.963814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:24.003158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:24.003809 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:24.004452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lazy-loading 'fault' on Instance uuid f72946e4-9448-4001-95ad-e03543a36ac8 {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:02:24.056918 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ae039c34c442f880c51aaf9024db8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dbb107721b4406b5c3e2f5081034fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:24.065792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7f404137-8269-4b4a-87a0-d9bae87e06f7 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 200 len: 1230 microversion: 2.1 time: 0.130204 Jun 23 11:02:24.066457 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 548/1125] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:23 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 1230 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:25.088440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:25.089123 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: f72946e4-9448-4001-95ad-e03543a36ac8] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:25.096868 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.097439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.098358 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.099021 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.116318 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] HTTP exception thrown: Instance f72946e4-9448-4001-95ad-e03543a36ac8 could not be found. Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Request method failure captured: Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 HTTP/1.1 Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEYNPhIHNrta-Ij_Wdy6in3BCJEwZbBcIb35A35e7f2Ydi1faIUvhInEo139qko6k2KU3Pte0GliMJhDTlfEowCqoPt7J83Hiiq4DAvuduVx5U-Jiew37nQbogcLdJCL1awC3QFEStG4F0ZkTmZj5r_Uqv-9cg4h5OgxQLysLtqoQ0I Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:02:25.118441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_79dbb107721b4406b5c3e2f5081034fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-TestVolumeBootPattern-402649719-project Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 10ae039c34c442f880c51aaf9024db8d Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-TestVolumeBootPattern-402649719-project Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance f72946e4-9448-4001-95ad-e03543a36ac8 could not be found. Jun 23 11:02:25.120883 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'f72946e4-9448-4001-95ad-e03543a36ac8'} Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f72946e4-9448-4001-95ad-e03543a36ac8 could not be found. Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:02:25.121715 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f72946e4-9448-4001-95ad-e03543a36ac8 could not be found. Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f72946e4-9448-4001-95ad-e03543a36ac8 could not be found. Jun 23 11:02:25.123017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.124194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Returning 404 to user: Instance f72946e4-9448-4001-95ad-e03543a36ac8 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:02:25.124194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-37d241b0-0bed-4e64-a059-5b2fc492f2a2 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8" status: 404 len: 111 microversion: 2.1 time: 0.036706 Jun 23 11:02:25.124194 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 578/1126] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:25 2022] GET /compute/v2.1/servers/f72946e4-9448-4001-95ad-e03543a36ac8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:02:25.622593 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:25.623267 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:25.632051 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.632693 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.633680 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.634291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.653190 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] HTTP exception thrown: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Request method failure captured: Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: DELETE /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 HTTP/1.1 Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEYNPhIHNrta-Ij_Wdy6in3BCJEwZbBcIb35A35e7f2Ydi1faIUvhInEo139qko6k2KU3Pte0GliMJhDTlfEowCqoPt7J83Hiiq4DAvuduVx5U-Jiew37nQbogcLdJCL1awC3QFEStG4F0ZkTmZj5r_Uqv-9cg4h5OgxQLysLtqoQ0I Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:02:25.655480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_79dbb107721b4406b5c3e2f5081034fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-TestVolumeBootPattern-402649719-project Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: 10ae039c34c442f880c51aaf9024db8d Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-TestVolumeBootPattern-402649719-project Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.657038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': 'b963bbb2-e54a-4996-82eb-ab728b7f94d4'} Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:02:25.657821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.659119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.660390 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Returning 404 to user: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:02:25.660390 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-6ae64161-e227-42b5-afcd-89a46c653aa5 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 404 len: 111 microversion: 2.1 time: 0.039398 Jun 23 11:02:25.660390 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 549/1127] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:02:25 2022] DELETE /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:02:25.668440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:25.669253 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [instance: b963bbb2-e54a-4996-82eb-ab728b7f94d4] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:25.675385 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.675833 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.676751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.677225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.692203 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] HTTP exception thrown: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Request method failure captured: Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 HTTP/1.1 Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEYNPhIHNrta-Ij_Wdy6in3BCJEwZbBcIb35A35e7f2Ydi1faIUvhInEo139qko6k2KU3Pte0GliMJhDTlfEowCqoPt7J83Hiiq4DAvuduVx5U-Jiew37nQbogcLdJCL1awC3QFEStG4F0ZkTmZj5r_Uqv-9cg4h5OgxQLysLtqoQ0I Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:02:25.694994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_79dbb107721b4406b5c3e2f5081034fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/79dbb107721b4406b5c3e2f5081034fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 79dbb107721b4406b5c3e2f5081034fd Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-TestVolumeBootPattern-402649719 Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-TestVolumeBootPattern-402649719-project Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 10ae039c34c442f880c51aaf9024db8d Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-TestVolumeBootPattern-402649719-project Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.696765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'b963bbb2-e54a-4996-82eb-ab728b7f94d4'} Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:02:25.697743 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. Jun 23 11:02:25.699850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:25.701282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Returning 404 to user: Instance b963bbb2-e54a-4996-82eb-ab728b7f94d4 could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:02:25.701282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-3ad46ad1-d7f6-4956-b06d-f4097adbfa86 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4" status: 404 len: 111 microversion: 2.1 time: 0.033071 Jun 23 11:02:25.701282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 579/1128] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:25 2022] GET /compute/v2.1/servers/b963bbb2-e54a-4996-82eb-ab728b7f94d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:02:27.030114 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c19224e2-2375-4ca5-a69d-be8e21674070 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] Calling method '.version_select at 0x7f8dc94a5b80>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:27.046828 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c19224e2-2375-4ca5-a69d-be8e21674070 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [2d955282-5b7a-47a7-af66-d296301641f3] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 11:02:27.474521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a6f0a4ec-6f59-47b8-a675-06c05711aefa tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:27.475064 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a6f0a4ec-6f59-47b8-a675-06c05711aefa tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:27.482641 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a6f0a4ec-6f59-47b8-a675-06c05711aefa tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:27.483088 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a6f0a4ec-6f59-47b8-a675-06c05711aefa tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:27.483989 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a6f0a4ec-6f59-47b8-a675-06c05711aefa tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:27.484424 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a6f0a4ec-6f59-47b8-a675-06c05711aefa tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:27.575040 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-a6f0a4ec-6f59-47b8-a675-06c05711aefa tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lazy-loading 'services' on Instance uuid 744f5654-f722-4d47-8a43-47e36916ccdb {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:02:27.823645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a6f0a4ec-6f59-47b8-a675-06c05711aefa tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "DELETE /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb/os-volume_attachments/a9d42e30-f228-49d5-8e66-c5536f4c5885" status: 202 len: 0 microversion: 2.1 time: 0.353269 Jun 23 11:02:27.824222 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 580/1129] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 11:02:27 2022] DELETE /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb/os-volume_attachments/a9d42e30-f228-49d5-8e66-c5536f4c5885 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:02:28.056289 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [None req-c19224e2-2375-4ca5-a69d-be8e21674070 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] [2d955282-5b7a-47a7-af66-d296301641f3] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 52446. Jun 23 11:02:28.063015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=29 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:28.076792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c19224e2-2375-4ca5-a69d-be8e21674070 tempest-TestVolumeBootPattern-402649719 tempest-TestVolumeBootPattern-402649719-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1984337626" status: 202 len: 0 microversion: 2.1 time: 1.051223 Jun 23 11:02:28.077357 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 550/1130] 10.222.0.39 () {58 vars in 1262 bytes} [Thu Jun 23 11:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1984337626 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:02:28.954482 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f4e14c5e-1b6d-4120-b613-1a2a5ca91116 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:28.955177 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f4e14c5e-1b6d-4120-b613-1a2a5ca91116 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:28.961642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f4e14c5e-1b6d-4120-b613-1a2a5ca91116 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:28.962176 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f4e14c5e-1b6d-4120-b613-1a2a5ca91116 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:28.963073 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f4e14c5e-1b6d-4120-b613-1a2a5ca91116 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:28.963511 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f4e14c5e-1b6d-4120-b613-1a2a5ca91116 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:28.991269 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f4e14c5e-1b6d-4120-b613-1a2a5ca91116 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:02:29.006849 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:29.079497 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f4e14c5e-1b6d-4120-b613-1a2a5ca91116 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "DELETE /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 204 len: 0 microversion: 2.1 time: 0.128765 Jun 23 11:02:29.080960 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 581/1131] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:02:28 2022] DELETE /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:02:29.094245 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f6274242-77d7-43d7-b826-d6f38fe95b85 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:29.095639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f6274242-77d7-43d7-b826-d6f38fe95b85 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:29.104834 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f6274242-77d7-43d7-b826-d6f38fe95b85 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:29.105274 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f6274242-77d7-43d7-b826-d6f38fe95b85 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:29.106047 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f6274242-77d7-43d7-b826-d6f38fe95b85 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:29.106512 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f6274242-77d7-43d7-b826-d6f38fe95b85 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:29.112153 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:29.341371 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f6274242-77d7-43d7-b826-d6f38fe95b85 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:29.349084 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f6274242-77d7-43d7-b826-d6f38fe95b85 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1515 microversion: 2.1 time: 0.263211 Jun 23 11:02:29.349654 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 551/1132] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:29 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:30.367982 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ceb9a12a-0fd5-490e-808e-9079da921645 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:30.370350 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ceb9a12a-0fd5-490e-808e-9079da921645 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:30.372856 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=3 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:30.381524 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ceb9a12a-0fd5-490e-808e-9079da921645 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:30.381982 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ceb9a12a-0fd5-490e-808e-9079da921645 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:30.383382 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ceb9a12a-0fd5-490e-808e-9079da921645 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:30.383831 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ceb9a12a-0fd5-490e-808e-9079da921645 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:30.635754 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ceb9a12a-0fd5-490e-808e-9079da921645 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:30.644145 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ceb9a12a-0fd5-490e-808e-9079da921645 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1515 microversion: 2.1 time: 0.280105 Jun 23 11:02:30.644729 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 582/1133] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:30 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:31.662429 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c80d2c10-e4e0-4516-b138-adec56235f34 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:31.663435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c80d2c10-e4e0-4516-b138-adec56235f34 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:31.683257 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c80d2c10-e4e0-4516-b138-adec56235f34 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:31.683743 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c80d2c10-e4e0-4516-b138-adec56235f34 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:31.684745 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c80d2c10-e4e0-4516-b138-adec56235f34 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:31.685205 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c80d2c10-e4e0-4516-b138-adec56235f34 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:31.814629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-d2bf3afd-6687-4dda-9ab8-11cd805cb9ae req-bcf17e1a-2f54-49ec-a7df-6748ecd31392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744f5654-f722-4d47-8a43-47e36916ccdb", "name": "network-vif-deleted", "tag": "6b5bde2c-7a07-4852-a1d2-e8881fbaba8d"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:31.836286 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-d2bf3afd-6687-4dda-9ab8-11cd805cb9ae req-bcf17e1a-2f54-49ec-a7df-6748ecd31392 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:31.836788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-d2bf3afd-6687-4dda-9ab8-11cd805cb9ae req-bcf17e1a-2f54-49ec-a7df-6748ecd31392 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:31.861010 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-d2bf3afd-6687-4dda-9ab8-11cd805cb9ae req-bcf17e1a-2f54-49ec-a7df-6748ecd31392 service nova] Creating event network-vif-deleted:6b5bde2c-7a07-4852-a1d2-e8881fbaba8d for instance 744f5654-f722-4d47-8a43-47e36916ccdb on hv-cinder-84614 Jun 23 11:02:31.863070 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c80d2c10-e4e0-4516-b138-adec56235f34 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:31.867591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-d2bf3afd-6687-4dda-9ab8-11cd805cb9ae req-bcf17e1a-2f54-49ec-a7df-6748ecd31392 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059222 Jun 23 11:02:31.873789 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 583/1134] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:31.877404 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c80d2c10-e4e0-4516-b138-adec56235f34 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 200 len: 1473 microversion: 2.1 time: 0.219911 Jun 23 11:02:31.890013 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 552/1135] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:31 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 1473 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:32.897583 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:32.898373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 744f5654-f722-4d47-8a43-47e36916ccdb] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:32.906127 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:32.906632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:32.907397 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:32.908017 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:32.923097 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] HTTP exception thrown: Instance 744f5654-f722-4d47-8a43-47e36916ccdb could not be found. Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Request method failure captured: Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb HTTP/1.1 Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEfucbaWxjyrqJ7BNHTo6dA-KgSX-gIw-7PqNBCtFOJuYUzirH3joLppwH8hqRPX7Tvu3_bW58SPA1scmh5XQF2i1SNCiGxVsbpjXTRYDdX2e_NfUB2WDbROgy0ZUnD0UD3vwn8qEshTnkIwJ40Z56s86uYphd0rxah76b6vn5zkvow Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 2a493f8e913a46c0bbc188ba94b91135 Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1869736362 Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:02:32.924751 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2a493f8e913a46c0bbc188ba94b91135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2a493f8e913a46c0bbc188ba94b91135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2a493f8e913a46c0bbc188ba94b91135", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2a493f8e913a46c0bbc188ba94b91135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-VolumesSnapshotTestJSON-1869736362 Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 2a493f8e913a46c0bbc188ba94b91135 Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1869736362 Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-VolumesSnapshotTestJSON-1869736362-project Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: a016506e3a104467bc09926acfba95b6 Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-VolumesSnapshotTestJSON-1869736362-project Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance 744f5654-f722-4d47-8a43-47e36916ccdb could not be found. Jun 23 11:02:32.926227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': '744f5654-f722-4d47-8a43-47e36916ccdb'} Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744f5654-f722-4d47-8a43-47e36916ccdb could not be found. Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:02:32.927068 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744f5654-f722-4d47-8a43-47e36916ccdb could not be found. Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744f5654-f722-4d47-8a43-47e36916ccdb could not be found. Jun 23 11:02:32.928388 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:02:32.929804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Returning 404 to user: Instance 744f5654-f722-4d47-8a43-47e36916ccdb could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:02:32.929804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bc3f0b64-e6c6-47ba-a4d9-660cc6f3b13e tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb" status: 404 len: 111 microversion: 2.1 time: 0.033873 Jun 23 11:02:32.929804 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 584/1136] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:32 2022] GET /compute/v2.1/servers/744f5654-f722-4d47-8a43-47e36916ccdb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:02:45.029707 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1918420239", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "networks": [{"uuid": "fdfc602c-1b74-4267-988a-80bd6be8c696"}]}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:45.037222 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:45.037885 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=11 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:45.086473 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] validate_networks() for [('fdfc602c-1b74-4267-988a-80bd6be8c696', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:02:45.634650 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:02:45.635256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:02:45.635937 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:02:45.636350 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:02:45.636771 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:02:45.646068 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.646550 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.647350 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.647785 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.668194 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Getting quotas for project 2a493f8e913a46c0bbc188ba94b91135. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:02:45.672868 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Getting quotas for user a016506e3a104467bc09926acfba95b6 and project 2a493f8e913a46c0bbc188ba94b91135. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:02:45.688628 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:02:45.690972 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:02:45.758653 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-8de867e8-333a-4a84-8555-1a96058f6c5b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732799 Jun 23 11:02:45.759549 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 553/1137] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 11:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:02:45.770600 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8ca39dd7-b24d-40bb-92fe-abcd2868c051 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:45.771297 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8ca39dd7-b24d-40bb-92fe-abcd2868c051 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:45.774904 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=5 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:45.776120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:45.841248 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8ca39dd7-b24d-40bb-92fe-abcd2868c051 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:45.848365 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8ca39dd7-b24d-40bb-92fe-abcd2868c051 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1219 microversion: 2.1 time: 0.082192 Jun 23 11:02:45.850440 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 585/1138] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:45 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:46.868965 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4047aab3-31e2-4a02-a20d-8f70d5f97da7 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:46.869709 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4047aab3-31e2-4a02-a20d-8f70d5f97da7 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:46.876762 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4047aab3-31e2-4a02-a20d-8f70d5f97da7 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:46.877209 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4047aab3-31e2-4a02-a20d-8f70d5f97da7 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:46.877974 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4047aab3-31e2-4a02-a20d-8f70d5f97da7 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:46.878426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4047aab3-31e2-4a02-a20d-8f70d5f97da7 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:46.946280 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4047aab3-31e2-4a02-a20d-8f70d5f97da7 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:46.955163 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4047aab3-31e2-4a02-a20d-8f70d5f97da7 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1279 microversion: 2.1 time: 0.091020 Jun 23 11:02:46.955934 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 554/1139] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:46 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:47.974507 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2f0c8694-d03e-4c51-b901-19ad14561308 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:47.975286 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2f0c8694-d03e-4c51-b901-19ad14561308 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:47.984828 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f0c8694-d03e-4c51-b901-19ad14561308 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:47.985359 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f0c8694-d03e-4c51-b901-19ad14561308 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:47.986578 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f0c8694-d03e-4c51-b901-19ad14561308 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:47.987064 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2f0c8694-d03e-4c51-b901-19ad14561308 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:48.140709 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2f0c8694-d03e-4c51-b901-19ad14561308 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:48.149570 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2f0c8694-d03e-4c51-b901-19ad14561308 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1319 microversion: 2.1 time: 0.179863 Jun 23 11:02:48.154160 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 586/1140] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:47 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:48.276731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-3bf1ae84-fa3a-4de0-9704-12483fb30d52 req-73abe1a8-2b9d-4387-a4a1-f5131dce470f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94045dfe-ff85-45e8-86e5-f54bdb89a04d", "tag": "1b7df7c9-345d-47d4-922d-fb784942a569"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:48.301520 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-3bf1ae84-fa3a-4de0-9704-12483fb30d52 req-73abe1a8-2b9d-4387-a4a1-f5131dce470f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:48.301968 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-3bf1ae84-fa3a-4de0-9704-12483fb30d52 req-73abe1a8-2b9d-4387-a4a1-f5131dce470f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:48.314387 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-3bf1ae84-fa3a-4de0-9704-12483fb30d52 req-73abe1a8-2b9d-4387-a4a1-f5131dce470f service nova] Creating event network-changed:1b7df7c9-345d-47d4-922d-fb784942a569 for instance 94045dfe-ff85-45e8-86e5-f54bdb89a04d on hv-cinder-84614 Jun 23 11:02:48.319912 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-3bf1ae84-fa3a-4de0-9704-12483fb30d52 req-73abe1a8-2b9d-4387-a4a1-f5131dce470f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050746 Jun 23 11:02:48.320516 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 555/1141] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:49.169670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7a99c7d0-5510-47c1-93df-31ee0af27d37 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:49.170369 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7a99c7d0-5510-47c1-93df-31ee0af27d37 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:49.177527 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a99c7d0-5510-47c1-93df-31ee0af27d37 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.177969 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a99c7d0-5510-47c1-93df-31ee0af27d37 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.178946 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a99c7d0-5510-47c1-93df-31ee0af27d37 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.179409 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7a99c7d0-5510-47c1-93df-31ee0af27d37 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.340226 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7a99c7d0-5510-47c1-93df-31ee0af27d37 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:49.347941 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7a99c7d0-5510-47c1-93df-31ee0af27d37 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1319 microversion: 2.1 time: 0.182584 Jun 23 11:02:49.348458 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 587/1142] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:49 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:50.371804 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c285b6dc-c7bb-49f6-aed6-cc593f295ad6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:50.372501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c285b6dc-c7bb-49f6-aed6-cc593f295ad6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:50.379792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c285b6dc-c7bb-49f6-aed6-cc593f295ad6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:50.380235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c285b6dc-c7bb-49f6-aed6-cc593f295ad6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:50.381015 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c285b6dc-c7bb-49f6-aed6-cc593f295ad6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:50.381447 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c285b6dc-c7bb-49f6-aed6-cc593f295ad6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:50.532683 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c285b6dc-c7bb-49f6-aed6-cc593f295ad6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:50.540762 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c285b6dc-c7bb-49f6-aed6-cc593f295ad6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1319 microversion: 2.1 time: 0.173530 Jun 23 11:02:50.541594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 556/1143] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:50 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:51.557744 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-389d978e-4421-402c-a966-7c5375108dd6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:51.558467 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-389d978e-4421-402c-a966-7c5375108dd6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:51.565055 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-389d978e-4421-402c-a966-7c5375108dd6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:51.565505 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-389d978e-4421-402c-a966-7c5375108dd6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:51.566279 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-389d978e-4421-402c-a966-7c5375108dd6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:51.566740 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-389d978e-4421-402c-a966-7c5375108dd6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:51.718436 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-389d978e-4421-402c-a966-7c5375108dd6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:51.726737 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-389d978e-4421-402c-a966-7c5375108dd6 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1319 microversion: 2.1 time: 0.172734 Jun 23 11:02:51.727596 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 588/1144] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:51 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:52.751332 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7ac25c42-7c45-4336-8b70-c73dce2222ea tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:52.751943 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7ac25c42-7c45-4336-8b70-c73dce2222ea tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:52.758657 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7ac25c42-7c45-4336-8b70-c73dce2222ea tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.759711 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7ac25c42-7c45-4336-8b70-c73dce2222ea tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.760522 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7ac25c42-7c45-4336-8b70-c73dce2222ea tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.760931 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7ac25c42-7c45-4336-8b70-c73dce2222ea tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.914817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7ac25c42-7c45-4336-8b70-c73dce2222ea tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:52.922825 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7ac25c42-7c45-4336-8b70-c73dce2222ea tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1319 microversion: 2.1 time: 0.175313 Jun 23 11:02:52.923402 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 557/1145] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:52 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:53.716463 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-ac7306e1-69ab-4f2c-bc00-50c0c3ad445e req-1913f398-f98b-4c3b-83d9-f9e24cb7d9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94045dfe-ff85-45e8-86e5-f54bdb89a04d", "name": "network-vif-plugged", "status": "completed", "tag": "1b7df7c9-345d-47d4-922d-fb784942a569"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:53.725290 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-ac7306e1-69ab-4f2c-bc00-50c0c3ad445e req-1913f398-f98b-4c3b-83d9-f9e24cb7d9dc service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:53.725736 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-ac7306e1-69ab-4f2c-bc00-50c0c3ad445e req-1913f398-f98b-4c3b-83d9-f9e24cb7d9dc service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:53.739972 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-ac7306e1-69ab-4f2c-bc00-50c0c3ad445e req-1913f398-f98b-4c3b-83d9-f9e24cb7d9dc service nova] Creating event network-vif-plugged:1b7df7c9-345d-47d4-922d-fb784942a569 for instance 94045dfe-ff85-45e8-86e5-f54bdb89a04d on hv-cinder-84614 Jun 23 11:02:53.746040 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-ac7306e1-69ab-4f2c-bc00-50c0c3ad445e req-1913f398-f98b-4c3b-83d9-f9e24cb7d9dc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214853 Jun 23 11:02:53.746707 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 589/1146] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:53.941396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9a4ffde0-f7c1-4f26-bce6-26fe0d839d89 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:53.942119 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9a4ffde0-f7c1-4f26-bce6-26fe0d839d89 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:53.953100 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9a4ffde0-f7c1-4f26-bce6-26fe0d839d89 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:53.953658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9a4ffde0-f7c1-4f26-bce6-26fe0d839d89 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:53.954976 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9a4ffde0-f7c1-4f26-bce6-26fe0d839d89 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:53.955657 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9a4ffde0-f7c1-4f26-bce6-26fe0d839d89 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:54.150038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9a4ffde0-f7c1-4f26-bce6-26fe0d839d89 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:54.159308 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9a4ffde0-f7c1-4f26-bce6-26fe0d839d89 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1319 microversion: 2.1 time: 0.221696 Jun 23 11:02:54.160050 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 558/1147] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:53 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:55.178778 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-40d7de6d-fdaf-4327-b8bd-7232fb145d5f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:55.179453 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-40d7de6d-fdaf-4327-b8bd-7232fb145d5f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:55.187205 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-40d7de6d-fdaf-4327-b8bd-7232fb145d5f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:55.187829 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-40d7de6d-fdaf-4327-b8bd-7232fb145d5f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:55.188734 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-40d7de6d-fdaf-4327-b8bd-7232fb145d5f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:55.189495 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-40d7de6d-fdaf-4327-b8bd-7232fb145d5f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:55.395151 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-40d7de6d-fdaf-4327-b8bd-7232fb145d5f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:55.409115 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-40d7de6d-fdaf-4327-b8bd-7232fb145d5f tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1319 microversion: 2.1 time: 0.234738 Jun 23 11:02:55.410035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 590/1148] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:55 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:56.431175 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-37145d4f-21f7-4fda-9d7b-69af897435ee tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:56.432057 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-37145d4f-21f7-4fda-9d7b-69af897435ee tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:56.434704 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:56.435553 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=6 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:56.444170 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-37145d4f-21f7-4fda-9d7b-69af897435ee tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:56.444946 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-37145d4f-21f7-4fda-9d7b-69af897435ee tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:56.446792 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-37145d4f-21f7-4fda-9d7b-69af897435ee tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:56.447154 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-37145d4f-21f7-4fda-9d7b-69af897435ee tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:56.636052 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-37145d4f-21f7-4fda-9d7b-69af897435ee tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:56.644291 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-37145d4f-21f7-4fda-9d7b-69af897435ee tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1509 microversion: 2.1 time: 0.217248 Jun 23 11:02:56.644926 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 559/1149] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:56 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:56.663417 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7c478d85-da47-4b7a-a508-1c85f5d5c982 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1bd9bea-2e54-49d4-9070-fcbc81b76611", "device": "/dev/sdb"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:56.665085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7c478d85-da47-4b7a-a508-1c85f5d5c982 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:56.667269 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:56.673234 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7c478d85-da47-4b7a-a508-1c85f5d5c982 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:56.673719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7c478d85-da47-4b7a-a508-1c85f5d5c982 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:56.674525 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7c478d85-da47-4b7a-a508-1c85f5d5c982 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:56.674986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7c478d85-da47-4b7a-a508-1c85f5d5c982 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:57.012927 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7c478d85-da47-4b7a-a508-1c85f5d5c982 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "POST /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352715 Jun 23 11:02:57.014777 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 591/1150] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 11:02:56 2022] POST /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:03.503821 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e3edc5a2-1f76-411b-963f-c132c0bc324e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:03.505582 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e3edc5a2-1f76-411b-963f-c132c0bc324e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:03.514519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e3edc5a2-1f76-411b-963f-c132c0bc324e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:03.514970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e3edc5a2-1f76-411b-963f-c132c0bc324e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:03.515757 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e3edc5a2-1f76-411b-963f-c132c0bc324e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:03.516189 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e3edc5a2-1f76-411b-963f-c132c0bc324e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:03.559710 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e3edc5a2-1f76-411b-963f-c132c0bc324e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063595 Jun 23 11:03:03.560362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 560/1151] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 11:03:03 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:03:03.626529 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8e7c49ba-7838-48b3-8c84-a34930ecb106 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:03.627547 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8e7c49ba-7838-48b3-8c84-a34930ecb106 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:03.638593 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8e7c49ba-7838-48b3-8c84-a34930ecb106 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:03.639391 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8e7c49ba-7838-48b3-8c84-a34930ecb106 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:03.640799 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8e7c49ba-7838-48b3-8c84-a34930ecb106 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:03.641619 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8e7c49ba-7838-48b3-8c84-a34930ecb106 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:03.689673 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8e7c49ba-7838-48b3-8c84-a34930ecb106 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:03:03.818748 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8e7c49ba-7838-48b3-8c84-a34930ecb106 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 204 len: 0 microversion: 2.1 time: 0.200803 Jun 23 11:03:03.819764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 592/1152] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:03:03 2022] DELETE /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:03:03.834536 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5da2da54-03a2-410a-ba33-1557474612fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:03.835362 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5da2da54-03a2-410a-ba33-1557474612fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:03.844003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5da2da54-03a2-410a-ba33-1557474612fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:03.844452 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5da2da54-03a2-410a-ba33-1557474612fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:03.845238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5da2da54-03a2-410a-ba33-1557474612fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:03.845673 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5da2da54-03a2-410a-ba33-1557474612fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:04.054560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5da2da54-03a2-410a-ba33-1557474612fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:04.064134 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5da2da54-03a2-410a-ba33-1557474612fd tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1675 microversion: 2.1 time: 0.236752 Jun 23 11:03:04.065142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 561/1153] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:03 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:05.096517 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-ead9240f-e1fe-41cc-93d0-4ccc8d4d9260 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:05.097631 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-ead9240f-e1fe-41cc-93d0-4ccc8d4d9260 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:05.109106 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ead9240f-e1fe-41cc-93d0-4ccc8d4d9260 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:05.110085 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ead9240f-e1fe-41cc-93d0-4ccc8d4d9260 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:05.111610 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ead9240f-e1fe-41cc-93d0-4ccc8d4d9260 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:05.112402 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-ead9240f-e1fe-41cc-93d0-4ccc8d4d9260 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:05.296232 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-ead9240f-e1fe-41cc-93d0-4ccc8d4d9260 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:05.310370 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-ead9240f-e1fe-41cc-93d0-4ccc8d4d9260 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1675 microversion: 2.1 time: 0.222994 Jun 23 11:03:05.311389 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 593/1154] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:05 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:06.340474 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-88dab855-8fe4-47fd-bf98-6e7d66daef68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:06.341625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-88dab855-8fe4-47fd-bf98-6e7d66daef68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:06.352699 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-88dab855-8fe4-47fd-bf98-6e7d66daef68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:06.353415 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-88dab855-8fe4-47fd-bf98-6e7d66daef68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:06.354740 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-88dab855-8fe4-47fd-bf98-6e7d66daef68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:06.355522 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-88dab855-8fe4-47fd-bf98-6e7d66daef68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:06.471199 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-2d3b0260-1752-45b0-b0a8-cc05c4e9cc51 req-3de7e592-9f91-4d89-9911-b2d9ba4d87c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a600cb79-ea27-4d68-8e08-1245e12ea0cf", "name": "network-vif-deleted", "tag": "b71d26a8-4ffa-4e4d-9499-880bd6b99314"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:06.482450 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-88dab855-8fe4-47fd-bf98-6e7d66daef68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:06.492853 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-2d3b0260-1752-45b0-b0a8-cc05c4e9cc51 req-3de7e592-9f91-4d89-9911-b2d9ba4d87c6 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:06.494163 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-2d3b0260-1752-45b0-b0a8-cc05c4e9cc51 req-3de7e592-9f91-4d89-9911-b2d9ba4d87c6 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:06.497787 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-88dab855-8fe4-47fd-bf98-6e7d66daef68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1607 microversion: 2.1 time: 0.165121 Jun 23 11:03:06.499657 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 562/1155] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:06 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1607 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:06.521084 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-2d3b0260-1752-45b0-b0a8-cc05c4e9cc51 req-3de7e592-9f91-4d89-9911-b2d9ba4d87c6 service nova] Creating event network-vif-deleted:b71d26a8-4ffa-4e4d-9499-880bd6b99314 for instance a600cb79-ea27-4d68-8e08-1245e12ea0cf on hv-cinder-84614 Jun 23 11:03:06.528460 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-2d3b0260-1752-45b0-b0a8-cc05c4e9cc51 req-3de7e592-9f91-4d89-9911-b2d9ba4d87c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065838 Jun 23 11:03:06.529481 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 594/1156] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:03:07.520436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c528dd5a-bc34-47c2-bce2-cc60b8e73b2d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:07.521497 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c528dd5a-bc34-47c2-bce2-cc60b8e73b2d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:07.532329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c528dd5a-bc34-47c2-bce2-cc60b8e73b2d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:07.532948 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c528dd5a-bc34-47c2-bce2-cc60b8e73b2d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:07.534992 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c528dd5a-bc34-47c2-bce2-cc60b8e73b2d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:07.535805 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c528dd5a-bc34-47c2-bce2-cc60b8e73b2d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:07.613902 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c528dd5a-bc34-47c2-bce2-cc60b8e73b2d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:07.620396 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c528dd5a-bc34-47c2-bce2-cc60b8e73b2d tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1607 microversion: 2.1 time: 0.106256 Jun 23 11:03:07.621150 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 563/1157] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:07 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1607 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:08.644483 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2c523940-8526-4eb4-9f04-2172e68a2559 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:08.645665 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2c523940-8526-4eb4-9f04-2172e68a2559 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:08.659615 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2c523940-8526-4eb4-9f04-2172e68a2559 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:08.660296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2c523940-8526-4eb4-9f04-2172e68a2559 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:08.661546 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2c523940-8526-4eb4-9f04-2172e68a2559 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:08.662222 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2c523940-8526-4eb4-9f04-2172e68a2559 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:08.761162 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2c523940-8526-4eb4-9f04-2172e68a2559 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:08.769150 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2c523940-8526-4eb4-9f04-2172e68a2559 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1323 microversion: 2.1 time: 0.133045 Jun 23 11:03:08.769735 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 595/1158] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:08 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1323 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:09.789299 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:09.791329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:09.801010 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:09.801510 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:09.802486 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:09.803090 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:09.851658 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:09.853195 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:09.853796 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lazy-loading 'fault' on Instance uuid a600cb79-ea27-4d68-8e08-1245e12ea0cf {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:03:09.915573 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:09.929752 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7d8b5478-be5d-4c33-8ede-556e33e64f59 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 200 len: 1328 microversion: 2.1 time: 0.145542 Jun 23 11:03:09.934575 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 564/1159] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:09 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 1328 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:10.957895 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:10.958993 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:10.967894 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.968376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.969198 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.969765 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.995037 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] HTTP exception thrown: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Request method failure captured: Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf HTTP/1.1 Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEcWtCQ4X4W7cx_AuBywqNXx2PWOX0jzEKwstqxWJxEVBwcn-ulcuYECb4LV3Si5NGZ3GB5cjFW9wTsqZECV4dNKeSpJWqOl5XJKG1zFRwSftgSpDSmQ98EV50l0wBpwmeuGyqd-_RsfONXcdmRUWdVC65EUzb1BGMG8wOo8JCpx73A Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:03:10.996845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_737af05e60014fe88e0238e00afb39c6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 845a039c954f4384917100206698d015 Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:03:10.999830 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'a600cb79-ea27-4d68-8e08-1245e12ea0cf'} Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:03:11.001439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:03:11.004418 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:03:11.006963 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Returning 404 to user: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:03:11.006963 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b2baa141-9e2c-4a7c-8c7a-020db18a49ae tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 404 len: 111 microversion: 2.1 time: 0.048080 Jun 23 11:03:11.006963 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 596/1160] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:10 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:03:11.013576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e6c2ccfb-2fdd-421d-a3b1-f8eced82a4dc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '.version_select at 0x7f8dc95919d0>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:11.043717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e6c2ccfb-2fdd-421d-a3b1-f8eced82a4dc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198565696" status: 202 len: 0 microversion: 2.1 time: 0.038305 Jun 23 11:03:11.044316 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 565/1161] 10.222.0.39 () {58 vars in 1220 bytes} [Thu Jun 23 11:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198565696 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:03:11.891949 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-efc2b37d-fa45-4bd1-a836-8e738dec48aa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'create', calling method: .version_select at 0x7f8dc90001f0>, body: {"keypair": {"name": "tempest-keypair-1225849576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqAxSY7w7s3Loq//D0dOO7p2NgBEhpJSn8glAcYWUOUzbtR8Fod+l0dmltE+LocxpXvVzduo4qb55/7FfizDHIyN/fd21b1UEKJG3z5EkpE+iQSBFbESsAkS2HwGGj+hw=="}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:11.913372 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-efc2b37d-fa45-4bd1-a836-8e738dec48aa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Getting quotas for project 737af05e60014fe88e0238e00afb39c6. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:03:11.921521 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-efc2b37d-fa45-4bd1-a836-8e738dec48aa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Getting quotas for user 845a039c954f4384917100206698d015 and project 737af05e60014fe88e0238e00afb39c6. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:03:11.961874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-efc2b37d-fa45-4bd1-a836-8e738dec48aa tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074608 Jun 23 11:03:11.963719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 597/1162] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 11:03:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:03:13.723632 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1341631849", "imageRef": "550a3fad-0901-46d2-adfe-94b34d0003ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5a1131b-deea-4d9e-9f06-b27c7d2c5b49"}], "security_groups": [{"name": "tempest-securitygroup--111446398"}], "key_name": "tempest-keypair-1225849576", "user_data": "}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:13.861300 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] validate_networks() for [('f5a1131b-deea-4d9e-9f06-b27c7d2c5b49', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:03:14.420739 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:03:14.422010 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:03:14.422428 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:03:14.423182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:03:14.423928 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:03:14.442017 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:14.442801 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:14.444512 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:14.445292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:14.470871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Getting quotas for project 737af05e60014fe88e0238e00afb39c6. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:03:14.475454 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Getting quotas for user 845a039c954f4384917100206698d015 and project 737af05e60014fe88e0238e00afb39c6. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:03:14.489170 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:03:14.491523 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='550a3fad-0901-46d2-adfe-94b34d0003ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:03:14.553227 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b009c933-0eca-484d-9f31-1ee7de071452 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.834168 Jun 23 11:03:14.554125 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 566/1163] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 11:03:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:03:14.573581 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f1a491fb-ed2d-46bc-9cb4-1eefd0d37ea1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:14.574814 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f1a491fb-ed2d-46bc-9cb4-1eefd0d37ea1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:14.667608 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f1a491fb-ed2d-46bc-9cb4-1eefd0d37ea1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:14.676604 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f1a491fb-ed2d-46bc-9cb4-1eefd0d37ea1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1238 microversion: 2.1 time: 0.111878 Jun 23 11:03:14.677233 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 598/1164] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:14 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:15.698726 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d8d226bd-541c-4ab3-aaab-52d823c6283b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:15.699467 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d8d226bd-541c-4ab3-aaab-52d823c6283b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:15.703187 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:15.773297 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d8d226bd-541c-4ab3-aaab-52d823c6283b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:15.781754 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d8d226bd-541c-4ab3-aaab-52d823c6283b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1238 microversion: 2.1 time: 0.088940 Jun 23 11:03:15.782376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 567/1165] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:15 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:16.800787 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-1432a1b0-8a90-4abe-b990-0101676c84e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:16.801657 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-1432a1b0-8a90-4abe-b990-0101676c84e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:16.803826 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:16.899001 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-1432a1b0-8a90-4abe-b990-0101676c84e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:16.910902 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-1432a1b0-8a90-4abe-b990-0101676c84e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1238 microversion: 2.1 time: 0.114129 Jun 23 11:03:16.911489 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 599/1166] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:16 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1238 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:17.931284 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-862cbce3-9bd9-4201-8848-882428033cf6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:17.932390 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-862cbce3-9bd9-4201-8848-882428033cf6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:18.024250 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-862cbce3-9bd9-4201-8848-882428033cf6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:18.036773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-862cbce3-9bd9-4201-8848-882428033cf6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1238 microversion: 2.1 time: 0.108953 Jun 23 11:03:18.048944 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 568/1167] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:17 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1238 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:19.068537 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-acb437be-4c5a-432d-ac2a-4d0e76e6c789 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:19.069593 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-acb437be-4c5a-432d-ac2a-4d0e76e6c789 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:19.082644 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-acb437be-4c5a-432d-ac2a-4d0e76e6c789 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.083224 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-acb437be-4c5a-432d-ac2a-4d0e76e6c789 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.084264 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-acb437be-4c5a-432d-ac2a-4d0e76e6c789 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.084850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-acb437be-4c5a-432d-ac2a-4d0e76e6c789 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.092266 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:19.152960 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-a2cd6566-c10c-453f-92e0-bd28353a5d97 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:19.154615 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-a2cd6566-c10c-453f-92e0-bd28353a5d97 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:19.165285 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2cd6566-c10c-453f-92e0-bd28353a5d97 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.166031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2cd6566-c10c-453f-92e0-bd28353a5d97 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.167026 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2cd6566-c10c-453f-92e0-bd28353a5d97 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.167632 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-a2cd6566-c10c-453f-92e0-bd28353a5d97 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.192770 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-acb437be-4c5a-432d-ac2a-4d0e76e6c789 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:19.202552 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=69 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:19.205114 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-acb437be-4c5a-432d-ac2a-4d0e76e6c789 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1242 microversion: 2.1 time: 0.142662 Jun 23 11:03:19.207110 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 600/1168] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:19 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1242 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:19.307692 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-a2cd6566-c10c-453f-92e0-bd28353a5d97 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lazy-loading 'services' on Instance uuid 94045dfe-ff85-45e8-86e5-f54bdb89a04d {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:03:19.413528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-a2cd6566-c10c-453f-92e0-bd28353a5d97 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "DELETE /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d/os-volume_attachments/e1bd9bea-2e54-49d4-9070-fcbc81b76611" status: 202 len: 0 microversion: 2.1 time: 0.267569 Jun 23 11:03:19.415265 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 569/1169] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 11:03:19 2022] DELETE /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d/os-volume_attachments/e1bd9bea-2e54-49d4-9070-fcbc81b76611 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:03:20.227703 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0532725c-d26f-405e-b43e-d81890c02280 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:20.229327 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0532725c-d26f-405e-b43e-d81890c02280 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:20.238420 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0532725c-d26f-405e-b43e-d81890c02280 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:20.239140 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0532725c-d26f-405e-b43e-d81890c02280 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:20.239967 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0532725c-d26f-405e-b43e-d81890c02280 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:20.240480 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0532725c-d26f-405e-b43e-d81890c02280 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:20.358250 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0532725c-d26f-405e-b43e-d81890c02280 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:20.371050 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0532725c-d26f-405e-b43e-d81890c02280 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1296 microversion: 2.1 time: 0.148672 Jun 23 11:03:20.371897 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 601/1170] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:20 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1296 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:21.403894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-eb70f829-e3b3-4125-bf81-6d6db37eebea tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:21.405735 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-eb70f829-e3b3-4125-bf81-6d6db37eebea tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:21.416632 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eb70f829-e3b3-4125-bf81-6d6db37eebea tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.417553 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eb70f829-e3b3-4125-bf81-6d6db37eebea tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.419172 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eb70f829-e3b3-4125-bf81-6d6db37eebea tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.419970 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-eb70f829-e3b3-4125-bf81-6d6db37eebea tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.636295 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-eb70f829-e3b3-4125-bf81-6d6db37eebea tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:21.658420 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-eb70f829-e3b3-4125-bf81-6d6db37eebea tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.261266 Jun 23 11:03:21.658420 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 570/1171] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:21 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:21.675981 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-07b27a56-6ae9-4894-a6a1-ff1d5db2ce2b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:21.676606 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-07b27a56-6ae9-4894-a6a1-ff1d5db2ce2b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:21.687379 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-07b27a56-6ae9-4894-a6a1-ff1d5db2ce2b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.688434 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-07b27a56-6ae9-4894-a6a1-ff1d5db2ce2b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.689843 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-07b27a56-6ae9-4894-a6a1-ff1d5db2ce2b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.690722 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-07b27a56-6ae9-4894-a6a1-ff1d5db2ce2b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.728139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-07b27a56-6ae9-4894-a6a1-ff1d5db2ce2b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:03:21.853856 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-07b27a56-6ae9-4894-a6a1-ff1d5db2ce2b tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "DELETE /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 204 len: 0 microversion: 2.1 time: 0.182027 Jun 23 11:03:21.854681 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 602/1172] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:03:21 2022] DELETE /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:03:21.866519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3db12019-5a8b-45d4-9ef7-1269c7460dcb tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:21.867150 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3db12019-5a8b-45d4-9ef7-1269c7460dcb tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:21.874135 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3db12019-5a8b-45d4-9ef7-1269c7460dcb tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.874625 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3db12019-5a8b-45d4-9ef7-1269c7460dcb tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.875656 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3db12019-5a8b-45d4-9ef7-1269c7460dcb tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.876091 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3db12019-5a8b-45d4-9ef7-1269c7460dcb tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.064935 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3db12019-5a8b-45d4-9ef7-1269c7460dcb tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:22.083381 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3db12019-5a8b-45d4-9ef7-1269c7460dcb tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1515 microversion: 2.1 time: 0.220422 Jun 23 11:03:22.087140 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 571/1173] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:21 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:22.341337 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-df12d365-dc49-4ee1-8166-6f2175c734b9 req-841323e7-ea6b-4fc2-aa33-84ee35ee5cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa3fb90-44b0-44ad-a090-35a851f054ee", "tag": "db71421a-1391-4c32-8c5c-aaedf9c34ec3"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:22.357065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-df12d365-dc49-4ee1-8166-6f2175c734b9 req-841323e7-ea6b-4fc2-aa33-84ee35ee5cf7 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:22.358136 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-df12d365-dc49-4ee1-8166-6f2175c734b9 req-841323e7-ea6b-4fc2-aa33-84ee35ee5cf7 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.379889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-df12d365-dc49-4ee1-8166-6f2175c734b9 req-841323e7-ea6b-4fc2-aa33-84ee35ee5cf7 service nova] Creating event network-changed:db71421a-1391-4c32-8c5c-aaedf9c34ec3 for instance efa3fb90-44b0-44ad-a090-35a851f054ee on hv-cinder-84614 Jun 23 11:03:22.388871 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-df12d365-dc49-4ee1-8166-6f2175c734b9 req-841323e7-ea6b-4fc2-aa33-84ee35ee5cf7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051901 Jun 23 11:03:22.389808 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 603/1174] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:03:22.685569 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-5dffdd4f-d08f-4293-a483-4c5bdf2a9a76 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:22.686578 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-5dffdd4f-d08f-4293-a483-4c5bdf2a9a76 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:22.698024 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dffdd4f-d08f-4293-a483-4c5bdf2a9a76 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:22.698516 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dffdd4f-d08f-4293-a483-4c5bdf2a9a76 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.699355 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dffdd4f-d08f-4293-a483-4c5bdf2a9a76 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:22.699793 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-5dffdd4f-d08f-4293-a483-4c5bdf2a9a76 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.909480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-5dffdd4f-d08f-4293-a483-4c5bdf2a9a76 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:22.920117 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-5dffdd4f-d08f-4293-a483-4c5bdf2a9a76 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.241499 Jun 23 11:03:22.920708 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 572/1175] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:22 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:23.113175 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-80e1fb2f-1456-4b29-9b9c-284eb4c7c7af tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:23.113962 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-80e1fb2f-1456-4b29-9b9c-284eb4c7c7af tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:23.122259 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-80e1fb2f-1456-4b29-9b9c-284eb4c7c7af tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.122826 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-80e1fb2f-1456-4b29-9b9c-284eb4c7c7af tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:23.123712 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-80e1fb2f-1456-4b29-9b9c-284eb4c7c7af tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.124139 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-80e1fb2f-1456-4b29-9b9c-284eb4c7c7af tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:23.295622 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-80e1fb2f-1456-4b29-9b9c-284eb4c7c7af tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:23.304532 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-80e1fb2f-1456-4b29-9b9c-284eb4c7c7af tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1515 microversion: 2.1 time: 0.196319 Jun 23 11:03:23.305247 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 604/1176] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:23 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:23.943302 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3cc307b5-f453-4b84-87be-e14e683f5ddf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:23.944669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3cc307b5-f453-4b84-87be-e14e683f5ddf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:23.955121 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3cc307b5-f453-4b84-87be-e14e683f5ddf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.955570 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3cc307b5-f453-4b84-87be-e14e683f5ddf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:23.956584 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3cc307b5-f453-4b84-87be-e14e683f5ddf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.957026 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3cc307b5-f453-4b84-87be-e14e683f5ddf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:24.147778 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3cc307b5-f453-4b84-87be-e14e683f5ddf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:24.161779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3cc307b5-f453-4b84-87be-e14e683f5ddf tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.225119 Jun 23 11:03:24.162875 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 573/1177] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:23 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:24.322612 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f9872434-a40e-42ba-90c8-bf703ec76bf3 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:24.324365 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f9872434-a40e-42ba-90c8-bf703ec76bf3 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:24.335305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9872434-a40e-42ba-90c8-bf703ec76bf3 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:24.336056 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9872434-a40e-42ba-90c8-bf703ec76bf3 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:24.337009 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9872434-a40e-42ba-90c8-bf703ec76bf3 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:24.337476 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f9872434-a40e-42ba-90c8-bf703ec76bf3 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:24.511296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f9872434-a40e-42ba-90c8-bf703ec76bf3 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:24.523193 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f9872434-a40e-42ba-90c8-bf703ec76bf3 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1515 microversion: 2.1 time: 0.204288 Jun 23 11:03:24.524759 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 605/1178] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:24 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:24.637173 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-0ee557b9-db0c-423a-a35a-dfcb0199889e req-094817a7-a916-44cc-8941-e0d90d07fcfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94045dfe-ff85-45e8-86e5-f54bdb89a04d", "name": "network-vif-deleted", "tag": "1b7df7c9-345d-47d4-922d-fb784942a569"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:24.640805 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:24.647916 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-0ee557b9-db0c-423a-a35a-dfcb0199889e req-094817a7-a916-44cc-8941-e0d90d07fcfe service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:24.648500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-0ee557b9-db0c-423a-a35a-dfcb0199889e req-094817a7-a916-44cc-8941-e0d90d07fcfe service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:24.666789 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-0ee557b9-db0c-423a-a35a-dfcb0199889e req-094817a7-a916-44cc-8941-e0d90d07fcfe service nova] Creating event network-vif-deleted:1b7df7c9-345d-47d4-922d-fb784942a569 for instance 94045dfe-ff85-45e8-86e5-f54bdb89a04d on hv-cinder-84614 Jun 23 11:03:24.676118 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-0ee557b9-db0c-423a-a35a-dfcb0199889e req-094817a7-a916-44cc-8941-e0d90d07fcfe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042322 Jun 23 11:03:24.677182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 574/1179] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:25.186451 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bddad3e2-dce9-4725-a02d-6be10e379b20 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:25.187978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bddad3e2-dce9-4725-a02d-6be10e379b20 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:25.197053 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bddad3e2-dce9-4725-a02d-6be10e379b20 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:25.197500 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bddad3e2-dce9-4725-a02d-6be10e379b20 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:25.198287 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bddad3e2-dce9-4725-a02d-6be10e379b20 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:25.198766 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bddad3e2-dce9-4725-a02d-6be10e379b20 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:25.391802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bddad3e2-dce9-4725-a02d-6be10e379b20 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:25.400732 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bddad3e2-dce9-4725-a02d-6be10e379b20 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.220954 Jun 23 11:03:25.401322 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 606/1180] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:25 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:25.550591 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2f229e2c-5c76-42b2-81d1-10726cc7fd46 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:25.551935 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2f229e2c-5c76-42b2-81d1-10726cc7fd46 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:25.561481 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f229e2c-5c76-42b2-81d1-10726cc7fd46 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:25.561972 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f229e2c-5c76-42b2-81d1-10726cc7fd46 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:25.562880 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f229e2c-5c76-42b2-81d1-10726cc7fd46 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:25.563317 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2f229e2c-5c76-42b2-81d1-10726cc7fd46 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:25.641365 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-2f229e2c-5c76-42b2-81d1-10726cc7fd46 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:25.649593 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2f229e2c-5c76-42b2-81d1-10726cc7fd46 tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1473 microversion: 2.1 time: 0.106985 Jun 23 11:03:25.650174 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 575/1181] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:25 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1473 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:26.420888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-84a0a3bc-7df8-43ca-8f4a-44029a5b6cdc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:26.421557 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-84a0a3bc-7df8-43ca-8f4a-44029a5b6cdc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:26.428376 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84a0a3bc-7df8-43ca-8f4a-44029a5b6cdc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.428816 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84a0a3bc-7df8-43ca-8f4a-44029a5b6cdc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.429595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84a0a3bc-7df8-43ca-8f4a-44029a5b6cdc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.430034 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-84a0a3bc-7df8-43ca-8f4a-44029a5b6cdc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.623968 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-84a0a3bc-7df8-43ca-8f4a-44029a5b6cdc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:26.634984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-84a0a3bc-7df8-43ca-8f4a-44029a5b6cdc tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.219032 Jun 23 11:03:26.636333 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 607/1182] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:26 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:26.673038 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:26.674072 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:26.682066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.682611 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.683586 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.684066 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.728533 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.729281 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.730093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lazy-loading 'fault' on Instance uuid 94045dfe-ff85-45e8-86e5-f54bdb89a04d {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:03:26.795329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a016506e3a104467bc09926acfba95b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a493f8e913a46c0bbc188ba94b91135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:26.809299 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-02eda8c3-b741-4d91-9fa6-796cd2c965dd tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 200 len: 1309 microversion: 2.1 time: 0.140308 Jun 23 11:03:26.810300 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 576/1183] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:26 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 1309 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:27.662632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bc56cb4a-52f1-49ac-802e-191ae8b81d45 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:27.663533 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bc56cb4a-52f1-49ac-802e-191ae8b81d45 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:27.666924 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=8 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:27.673252 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc56cb4a-52f1-49ac-802e-191ae8b81d45 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.673703 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc56cb4a-52f1-49ac-802e-191ae8b81d45 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.674538 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc56cb4a-52f1-49ac-802e-191ae8b81d45 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.674977 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-bc56cb4a-52f1-49ac-802e-191ae8b81d45 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.837028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:27.838077 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] [instance: 94045dfe-ff85-45e8-86e5-f54bdb89a04d] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:27.850078 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.850861 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.852949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.853754 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.873684 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] HTTP exception thrown: Instance 94045dfe-ff85-45e8-86e5-f54bdb89a04d could not be found. Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Request method failure captured: Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d HTTP/1.1 Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEfucbaWxjyrqJ7BNHTo6dA-KgSX-gIw-7PqNBCtFOJuYUzirH3joLppwH8hqRPX7Tvu3_bW58SPA1scmh5XQF2i1SNCiGxVsbpjXTRYDdX2e_NfUB2WDbROgy0ZUnD0UD3vwn8qEshTnkIwJ40Z56s86uYphd0rxah76b6vn5zkvow Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 2a493f8e913a46c0bbc188ba94b91135 Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1869736362 Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:03:27.875445 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2a493f8e913a46c0bbc188ba94b91135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2a493f8e913a46c0bbc188ba94b91135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2a493f8e913a46c0bbc188ba94b91135", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2a493f8e913a46c0bbc188ba94b91135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-VolumesSnapshotTestJSON-1869736362 Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 2a493f8e913a46c0bbc188ba94b91135 Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1869736362 Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-VolumesSnapshotTestJSON-1869736362-project Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: a016506e3a104467bc09926acfba95b6 Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-VolumesSnapshotTestJSON-1869736362-project Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 94045dfe-ff85-45e8-86e5-f54bdb89a04d could not be found. Jun 23 11:03:27.878219 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '94045dfe-ff85-45e8-86e5-f54bdb89a04d'} Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94045dfe-ff85-45e8-86e5-f54bdb89a04d could not be found. Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:03:27.879830 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94045dfe-ff85-45e8-86e5-f54bdb89a04d could not be found. Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94045dfe-ff85-45e8-86e5-f54bdb89a04d could not be found. Jun 23 11:03:27.882011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.884731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] Returning 404 to user: Instance 94045dfe-ff85-45e8-86e5-f54bdb89a04d could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:03:27.884731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3472c48c-9773-46ec-b12e-36da4e9931ec tempest-VolumesSnapshotTestJSON-1869736362 tempest-VolumesSnapshotTestJSON-1869736362-project] 10.222.0.39 "GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d" status: 404 len: 111 microversion: 2.1 time: 0.047924 Jun 23 11:03:27.884731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 577/1184] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:27 2022] GET /compute/v2.1/servers/94045dfe-ff85-45e8-86e5-f54bdb89a04d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:03:28.138035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bc56cb4a-52f1-49ac-802e-191ae8b81d45 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:28.146792 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bc56cb4a-52f1-49ac-802e-191ae8b81d45 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.488164 Jun 23 11:03:28.147468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 608/1185] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:27 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:29.168496 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-67f14216-5494-4584-9274-020737174f7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:29.169323 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-67f14216-5494-4584-9274-020737174f7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:29.172330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=10 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:29.177583 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-67f14216-5494-4584-9274-020737174f7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:29.178030 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-67f14216-5494-4584-9274-020737174f7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:29.178849 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-67f14216-5494-4584-9274-020737174f7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:29.179281 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-67f14216-5494-4584-9274-020737174f7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:29.365708 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-67f14216-5494-4584-9274-020737174f7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:29.377123 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-67f14216-5494-4584-9274-020737174f7b tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.213401 Jun 23 11:03:29.377703 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 578/1186] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:29 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:30.395613 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2a2e51e7-6345-411a-9f06-6b119c1844a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:30.396436 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2a2e51e7-6345-411a-9f06-6b119c1844a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:30.406711 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a2e51e7-6345-411a-9f06-6b119c1844a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:30.407227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a2e51e7-6345-411a-9f06-6b119c1844a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:30.408392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a2e51e7-6345-411a-9f06-6b119c1844a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:30.409101 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2a2e51e7-6345-411a-9f06-6b119c1844a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:30.611997 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2a2e51e7-6345-411a-9f06-6b119c1844a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:30.626305 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2a2e51e7-6345-411a-9f06-6b119c1844a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.235022 Jun 23 11:03:30.627227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 609/1187] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:30 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:31.496173 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-1f61b938-41e7-4d9b-806b-d484e094acf3 req-434c1999-84e8-41aa-8301-694117cf34b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa3fb90-44b0-44ad-a090-35a851f054ee", "name": "network-vif-plugged", "status": "completed", "tag": "db71421a-1391-4c32-8c5c-aaedf9c34ec3"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:31.513126 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-1f61b938-41e7-4d9b-806b-d484e094acf3 req-434c1999-84e8-41aa-8301-694117cf34b9 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:31.513963 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-1f61b938-41e7-4d9b-806b-d484e094acf3 req-434c1999-84e8-41aa-8301-694117cf34b9 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:31.540671 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-1f61b938-41e7-4d9b-806b-d484e094acf3 req-434c1999-84e8-41aa-8301-694117cf34b9 service nova] Creating event network-vif-plugged:db71421a-1391-4c32-8c5c-aaedf9c34ec3 for instance efa3fb90-44b0-44ad-a090-35a851f054ee on hv-cinder-84614 Jun 23 11:03:31.545799 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-1f61b938-41e7-4d9b-806b-d484e094acf3 req-434c1999-84e8-41aa-8301-694117cf34b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056371 Jun 23 11:03:31.546450 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 579/1188] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:31.653764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d180bb10-17ce-4b07-ba46-ca9ddaeea2e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:31.653764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d180bb10-17ce-4b07-ba46-ca9ddaeea2e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:31.658627 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d180bb10-17ce-4b07-ba46-ca9ddaeea2e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:31.659225 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d180bb10-17ce-4b07-ba46-ca9ddaeea2e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:31.660329 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d180bb10-17ce-4b07-ba46-ca9ddaeea2e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:31.660888 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d180bb10-17ce-4b07-ba46-ca9ddaeea2e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:31.861817 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d180bb10-17ce-4b07-ba46-ca9ddaeea2e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:31.871153 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d180bb10-17ce-4b07-ba46-ca9ddaeea2e6 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.228830 Jun 23 11:03:31.871921 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 610/1189] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:31 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:32.896354 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d75f01a0-4838-4b0a-a9fc-55b3a230a4a3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:32.897210 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d75f01a0-4838-4b0a-a9fc-55b3a230a4a3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:32.905167 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d75f01a0-4838-4b0a-a9fc-55b3a230a4a3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:32.905616 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d75f01a0-4838-4b0a-a9fc-55b3a230a4a3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:32.906436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d75f01a0-4838-4b0a-a9fc-55b3a230a4a3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:32.906871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d75f01a0-4838-4b0a-a9fc-55b3a230a4a3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:33.085669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d75f01a0-4838-4b0a-a9fc-55b3a230a4a3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:33.095855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d75f01a0-4838-4b0a-a9fc-55b3a230a4a3 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.208370 Jun 23 11:03:33.096427 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 580/1190] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:32 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:34.115221 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b4cbf23f-0c22-4c30-a407-54cd9ee57066 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:34.116069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b4cbf23f-0c22-4c30-a407-54cd9ee57066 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:34.124643 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b4cbf23f-0c22-4c30-a407-54cd9ee57066 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:34.125136 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b4cbf23f-0c22-4c30-a407-54cd9ee57066 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:34.129992 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b4cbf23f-0c22-4c30-a407-54cd9ee57066 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:34.130548 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b4cbf23f-0c22-4c30-a407-54cd9ee57066 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:34.169211 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:03:34.169571 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Thu Jun 23 11:03:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee (ip 10.222.0.39) !!! Jun 23 11:03:34.318498 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b4cbf23f-0c22-4c30-a407-54cd9ee57066 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:34.330850 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b4cbf23f-0c22-4c30-a407-54cd9ee57066 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.219342 Jun 23 11:03:34.331889 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 611/1191] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:34 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:35.353495 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f9cc85fc-c746-4150-b975-c78b177aeac7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:35.354364 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f9cc85fc-c746-4150-b975-c78b177aeac7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:35.365188 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f9cc85fc-c746-4150-b975-c78b177aeac7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:35.366018 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f9cc85fc-c746-4150-b975-c78b177aeac7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:35.368100 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f9cc85fc-c746-4150-b975-c78b177aeac7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:35.369042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f9cc85fc-c746-4150-b975-c78b177aeac7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:35.570182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-f9cc85fc-c746-4150-b975-c78b177aeac7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:35.585006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f9cc85fc-c746-4150-b975-c78b177aeac7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1363 microversion: 2.1 time: 0.238064 Jun 23 11:03:35.586054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 581/1192] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:35 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:36.617774 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4c339b44-7f77-48f8-82b0-fe615ce99b1e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:36.618828 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4c339b44-7f77-48f8-82b0-fe615ce99b1e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:36.627493 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4c339b44-7f77-48f8-82b0-fe615ce99b1e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.627983 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4c339b44-7f77-48f8-82b0-fe615ce99b1e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.628869 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4c339b44-7f77-48f8-82b0-fe615ce99b1e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.629304 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4c339b44-7f77-48f8-82b0-fe615ce99b1e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.824649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4c339b44-7f77-48f8-82b0-fe615ce99b1e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:36.839049 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4c339b44-7f77-48f8-82b0-fe615ce99b1e tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1550 microversion: 2.1 time: 0.231627 Jun 23 11:03:36.840799 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 612/1193] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:36 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1550 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:36.868009 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-778f076d-27ff-4c93-95a6-62267f45606f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:36.868876 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-778f076d-27ff-4c93-95a6-62267f45606f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:36.880262 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-778f076d-27ff-4c93-95a6-62267f45606f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.881031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-778f076d-27ff-4c93-95a6-62267f45606f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.882373 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-778f076d-27ff-4c93-95a6-62267f45606f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.883154 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-778f076d-27ff-4c93-95a6-62267f45606f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.994731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-778f076d-27ff-4c93-95a6-62267f45606f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134364 Jun 23 11:03:36.995519 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 582/1194] 10.222.0.39 () {58 vars in 1274 bytes} [Thu Jun 23 11:03:36 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:03:38.268446 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-52eace48-6c89-40ca-a94e-8e22ae211bc0 req-6f95b09e-d43f-4551-8adb-9bcff86589e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa3fb90-44b0-44ad-a090-35a851f054ee", "tag": "db71421a-1391-4c32-8c5c-aaedf9c34ec3"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:38.279284 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-52eace48-6c89-40ca-a94e-8e22ae211bc0 req-6f95b09e-d43f-4551-8adb-9bcff86589e1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:38.279860 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-52eace48-6c89-40ca-a94e-8e22ae211bc0 req-6f95b09e-d43f-4551-8adb-9bcff86589e1 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:38.296094 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-52eace48-6c89-40ca-a94e-8e22ae211bc0 req-6f95b09e-d43f-4551-8adb-9bcff86589e1 service nova] Creating event network-changed:db71421a-1391-4c32-8c5c-aaedf9c34ec3 for instance efa3fb90-44b0-44ad-a090-35a851f054ee on hv-cinder-84614 Jun 23 11:03:38.304760 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-52eace48-6c89-40ca-a94e-8e22ae211bc0 req-6f95b09e-d43f-4551-8adb-9bcff86589e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041783 Jun 23 11:03:38.306212 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 613/1195] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:04:53.894978 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=37 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:53.896238 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:53.901488 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-49d66a54-0158-41b6-aa4a-f90d5d42954c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:53.901976 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-49d66a54-0158-41b6-aa4a-f90d5d42954c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:53.910907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-49d66a54-0158-41b6-aa4a-f90d5d42954c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:53.911456 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-49d66a54-0158-41b6-aa4a-f90d5d42954c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:53.912279 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-49d66a54-0158-41b6-aa4a-f90d5d42954c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:53.912888 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-49d66a54-0158-41b6-aa4a-f90d5d42954c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:53.941147 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-49d66a54-0158-41b6-aa4a-f90d5d42954c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/ips" status: 200 len: 147 microversion: 2.1 time: 0.049468 Jun 23 11:04:53.941715 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 583/1196] 10.222.0.39 () {58 vars in 1247 bytes} [Thu Jun 23 11:04:53 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/ips => generated 147 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:55.385307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:55.386413 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:55.392496 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0dbaaf51-2e27-445c-b10d-fe15cae627a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aab59be1-2385-42a7-8ee1-e0294c60e2ac"}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:55.393874 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0dbaaf51-2e27-445c-b10d-fe15cae627a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:55.405441 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dbaaf51-2e27-445c-b10d-fe15cae627a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:55.406075 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dbaaf51-2e27-445c-b10d-fe15cae627a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:55.407135 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dbaaf51-2e27-445c-b10d-fe15cae627a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:55.407630 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0dbaaf51-2e27-445c-b10d-fe15cae627a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:55.752015 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0dbaaf51-2e27-445c-b10d-fe15cae627a1 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368446 Jun 23 11:04:55.753129 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 614/1197] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 11:04:55 2022] POST /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:05:03.392740 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-76e848d4-6e12-4123-a958-f8ad073b5175 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:03.393867 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-76e848d4-6e12-4123-a958-f8ad073b5175 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:03.401894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-76e848d4-6e12-4123-a958-f8ad073b5175 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:03.402809 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-76e848d4-6e12-4123-a958-f8ad073b5175 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:03.403824 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-76e848d4-6e12-4123-a958-f8ad073b5175 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:03.404316 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-76e848d4-6e12-4123-a958-f8ad073b5175 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:03.439731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-76e848d4-6e12-4123-a958-f8ad073b5175 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052496 Jun 23 11:05:03.440310 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 584/1198] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 11:05:03 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:03.452065 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a5b1988d-7094-4c60-8a01-bcb01b199a4a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:03.452658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a5b1988d-7094-4c60-8a01-bcb01b199a4a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:03.459390 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5b1988d-7094-4c60-8a01-bcb01b199a4a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:03.460472 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5b1988d-7094-4c60-8a01-bcb01b199a4a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:03.461334 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5b1988d-7094-4c60-8a01-bcb01b199a4a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:03.461776 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a5b1988d-7094-4c60-8a01-bcb01b199a4a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:03.494041 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a5b1988d-7094-4c60-8a01-bcb01b199a4a tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/aab59be1-2385-42a7-8ee1-e0294c60e2ac" status: 200 len: 194 microversion: 2.1 time: 0.046895 Jun 23 11:05:03.494680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 615/1199] 10.222.0.39 () {58 vars in 1412 bytes} [Thu Jun 23 11:05:03 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/aab59be1-2385-42a7-8ee1-e0294c60e2ac => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:04.902589 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-36c65228-8819-44cc-adf9-056c39aaccf9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "098bd5aa-fd1c-4928-b6d1-bbc202442af5"}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:05:04.904113 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-36c65228-8819-44cc-adf9-056c39aaccf9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:04.916474 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-36c65228-8819-44cc-adf9-056c39aaccf9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:04.917266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-36c65228-8819-44cc-adf9-056c39aaccf9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:04.918910 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-36c65228-8819-44cc-adf9-056c39aaccf9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:04.919704 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-36c65228-8819-44cc-adf9-056c39aaccf9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:05.662828 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-36c65228-8819-44cc-adf9-056c39aaccf9 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "POST /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766684 Jun 23 11:05:05.663504 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 585/1200] 10.222.0.39 () {60 vars in 1322 bytes} [Thu Jun 23 11:05:04 2022] POST /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:13.390652 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-56b3f9f2-eba3-41c4-b7d3-28d22bda20a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:13.392380 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-56b3f9f2-eba3-41c4-b7d3-28d22bda20a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:13.403629 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-56b3f9f2-eba3-41c4-b7d3-28d22bda20a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:13.404132 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-56b3f9f2-eba3-41c4-b7d3-28d22bda20a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:13.404949 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-56b3f9f2-eba3-41c4-b7d3-28d22bda20a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:13.405528 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-56b3f9f2-eba3-41c4-b7d3-28d22bda20a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:13.464820 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-56b3f9f2-eba3-41c4-b7d3-28d22bda20a4 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.081612 Jun 23 11:05:13.465913 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 616/1201] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 11:05:13 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:13.623524 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4f4be466-107c-4860-82c0-5fd40172ab95 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:13.624630 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4f4be466-107c-4860-82c0-5fd40172ab95 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:13.636420 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f4be466-107c-4860-82c0-5fd40172ab95 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:13.637155 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f4be466-107c-4860-82c0-5fd40172ab95 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:13.638298 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f4be466-107c-4860-82c0-5fd40172ab95 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:13.639107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4f4be466-107c-4860-82c0-5fd40172ab95 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:13.687340 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4f4be466-107c-4860-82c0-5fd40172ab95 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/aab59be1-2385-42a7-8ee1-e0294c60e2ac" status: 200 len: 194 microversion: 2.1 time: 0.072520 Jun 23 11:05:13.689641 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 586/1202] 10.222.0.39 () {58 vars in 1412 bytes} [Thu Jun 23 11:05:13 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/aab59be1-2385-42a7-8ee1-e0294c60e2ac => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:13.703280 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-02845bc7-6051-4136-aa19-62f889186cb7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:13.703772 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-02845bc7-6051-4136-aa19-62f889186cb7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:13.711757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-02845bc7-6051-4136-aa19-62f889186cb7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:13.712207 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-02845bc7-6051-4136-aa19-62f889186cb7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:13.712986 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-02845bc7-6051-4136-aa19-62f889186cb7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:13.713483 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-02845bc7-6051-4136-aa19-62f889186cb7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:13.933921 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-02845bc7-6051-4136-aa19-62f889186cb7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lazy-loading 'services' on Instance uuid efa3fb90-44b0-44ad-a090-35a851f054ee {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:05:14.065492 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-02845bc7-6051-4136-aa19-62f889186cb7 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/aab59be1-2385-42a7-8ee1-e0294c60e2ac" status: 202 len: 0 microversion: 2.1 time: 0.366698 Jun 23 11:05:14.066079 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 617/1203] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 11:05:13 2022] DELETE /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/aab59be1-2385-42a7-8ee1-e0294c60e2ac => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:05:15.228944 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c7777169-6609-4694-b9ce-d030ef0248c5 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:15.229835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c7777169-6609-4694-b9ce-d030ef0248c5 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:15.240449 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c7777169-6609-4694-b9ce-d030ef0248c5 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:15.241874 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c7777169-6609-4694-b9ce-d030ef0248c5 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:15.243075 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c7777169-6609-4694-b9ce-d030ef0248c5 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:15.243772 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c7777169-6609-4694-b9ce-d030ef0248c5 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:15.299335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c7777169-6609-4694-b9ce-d030ef0248c5 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/098bd5aa-fd1c-4928-b6d1-bbc202442af5" status: 200 len: 194 microversion: 2.1 time: 0.076051 Jun 23 11:05:15.300436 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 587/1204] 10.222.0.39 () {58 vars in 1412 bytes} [Thu Jun 23 11:05:15 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/098bd5aa-fd1c-4928-b6d1-bbc202442af5 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:15.315279 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fc7fb310-06df-4cba-a8d7-4ae9b9afdd75 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:15.316120 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fc7fb310-06df-4cba-a8d7-4ae9b9afdd75 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:15.324606 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc7fb310-06df-4cba-a8d7-4ae9b9afdd75 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:15.325069 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc7fb310-06df-4cba-a8d7-4ae9b9afdd75 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:15.325907 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc7fb310-06df-4cba-a8d7-4ae9b9afdd75 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:15.326392 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fc7fb310-06df-4cba-a8d7-4ae9b9afdd75 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:15.433296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.objects.instance [None req-fc7fb310-06df-4cba-a8d7-4ae9b9afdd75 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lazy-loading 'services' on Instance uuid efa3fb90-44b0-44ad-a090-35a851f054ee {{(pid=129460) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:05:15.558591 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fc7fb310-06df-4cba-a8d7-4ae9b9afdd75 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/098bd5aa-fd1c-4928-b6d1-bbc202442af5" status: 202 len: 0 microversion: 2.1 time: 0.248399 Jun 23 11:05:15.559442 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 618/1205] 10.222.0.39 () {58 vars in 1415 bytes} [Thu Jun 23 11:05:15 2022] DELETE /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments/098bd5aa-fd1c-4928-b6d1-bbc202442af5 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:05:16.817501 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d0a245dc-ef2c-4b7f-82f2-3af414fab279 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:16.819511 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d0a245dc-ef2c-4b7f-82f2-3af414fab279 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:16.826384 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d0a245dc-ef2c-4b7f-82f2-3af414fab279 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:16.826838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d0a245dc-ef2c-4b7f-82f2-3af414fab279 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:16.827626 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d0a245dc-ef2c-4b7f-82f2-3af414fab279 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:16.828060 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d0a245dc-ef2c-4b7f-82f2-3af414fab279 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:16.867478 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d0a245dc-ef2c-4b7f-82f2-3af414fab279 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056621 Jun 23 11:05:16.868056 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 588/1206] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 11:05:16 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 11:05:16.998246 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6336c8b7-2d49-41ab-acf7-583483baa297 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:16.999873 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6336c8b7-2d49-41ab-acf7-583483baa297 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:17.008344 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6336c8b7-2d49-41ab-acf7-583483baa297 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:17.008793 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6336c8b7-2d49-41ab-acf7-583483baa297 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:17.009580 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6336c8b7-2d49-41ab-acf7-583483baa297 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:17.010011 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6336c8b7-2d49-41ab-acf7-583483baa297 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:17.045719 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6336c8b7-2d49-41ab-acf7-583483baa297 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057931 Jun 23 11:05:17.046297 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 619/1207] 10.222.0.39 () {58 vars in 1301 bytes} [Thu Jun 23 11:05:16 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:05:17.131383 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b6d6c12d-1d78-46c3-9bc9-fc27e0d3157f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:17.132037 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b6d6c12d-1d78-46c3-9bc9-fc27e0d3157f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:17.138585 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b6d6c12d-1d78-46c3-9bc9-fc27e0d3157f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:17.139031 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b6d6c12d-1d78-46c3-9bc9-fc27e0d3157f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:17.139807 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b6d6c12d-1d78-46c3-9bc9-fc27e0d3157f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:17.140240 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b6d6c12d-1d78-46c3-9bc9-fc27e0d3157f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:17.171162 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b6d6c12d-1d78-46c3-9bc9-fc27e0d3157f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Going to try to terminate instance {{(pid=129461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:05:17.261003 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b6d6c12d-1d78-46c3-9bc9-fc27e0d3157f tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 204 len: 0 microversion: 2.1 time: 0.133417 Jun 23 11:05:17.261730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 589/1208] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:05:17 2022] DELETE /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:05:17.275389 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6ad3b75c-963d-4ebd-8003-86a95635e77c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:17.276634 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6ad3b75c-963d-4ebd-8003-86a95635e77c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:17.286479 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ad3b75c-963d-4ebd-8003-86a95635e77c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:17.287025 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ad3b75c-963d-4ebd-8003-86a95635e77c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:17.288663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ad3b75c-963d-4ebd-8003-86a95635e77c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:17.289279 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6ad3b75c-963d-4ebd-8003-86a95635e77c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:17.467181 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-6ad3b75c-963d-4ebd-8003-86a95635e77c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:17.480497 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6ad3b75c-963d-4ebd-8003-86a95635e77c tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1675 microversion: 2.1 time: 0.212826 Jun 23 11:05:17.481175 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 620/1209] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:17 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1675 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:18.500343 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c36cd2cd-c5cb-4eae-b077-96ffa88458c0 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:18.501285 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c36cd2cd-c5cb-4eae-b077-96ffa88458c0 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:18.511399 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c36cd2cd-c5cb-4eae-b077-96ffa88458c0 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:18.511902 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c36cd2cd-c5cb-4eae-b077-96ffa88458c0 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:18.512768 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c36cd2cd-c5cb-4eae-b077-96ffa88458c0 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:18.513594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c36cd2cd-c5cb-4eae-b077-96ffa88458c0 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:18.738842 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c36cd2cd-c5cb-4eae-b077-96ffa88458c0 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:18.752674 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c36cd2cd-c5cb-4eae-b077-96ffa88458c0 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1675 microversion: 2.1 time: 0.256705 Jun 23 11:05:18.753189 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 590/1210] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:18 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1675 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:19.780185 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-0c7dd998-b62e-4467-8c3f-dc7967b36a68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:19.781321 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-0c7dd998-b62e-4467-8c3f-dc7967b36a68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:19.790758 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0c7dd998-b62e-4467-8c3f-dc7967b36a68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:19.791316 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0c7dd998-b62e-4467-8c3f-dc7967b36a68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:19.792195 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0c7dd998-b62e-4467-8c3f-dc7967b36a68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:19.792707 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-0c7dd998-b62e-4467-8c3f-dc7967b36a68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:20.001553 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-0c7dd998-b62e-4467-8c3f-dc7967b36a68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845a039c954f4384917100206698d015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737af05e60014fe88e0238e00afb39c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:20.015365 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-0c7dd998-b62e-4467-8c3f-dc7967b36a68 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 200 len: 1675 microversion: 2.1 time: 0.241936 Jun 23 11:05:20.016404 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 621/1211] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:19 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:20.499579 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-fc7d5b79-8f0c-4cbb-8e8b-4285783b17ec req-c7f61122-ff66-43dd-b498-3081eb3eeabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa3fb90-44b0-44ad-a090-35a851f054ee", "name": "network-vif-deleted", "tag": "db71421a-1391-4c32-8c5c-aaedf9c34ec3"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:05:20.517631 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-fc7d5b79-8f0c-4cbb-8e8b-4285783b17ec req-c7f61122-ff66-43dd-b498-3081eb3eeabf service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:20.521711 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-fc7d5b79-8f0c-4cbb-8e8b-4285783b17ec req-c7f61122-ff66-43dd-b498-3081eb3eeabf service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:20.546193 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-fc7d5b79-8f0c-4cbb-8e8b-4285783b17ec req-c7f61122-ff66-43dd-b498-3081eb3eeabf service nova] Creating event network-vif-deleted:db71421a-1391-4c32-8c5c-aaedf9c34ec3 for instance efa3fb90-44b0-44ad-a090-35a851f054ee on hv-cinder-84614 Jun 23 11:05:20.554751 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-fc7d5b79-8f0c-4cbb-8e8b-4285783b17ec req-c7f61122-ff66-43dd-b498-3081eb3eeabf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068798 Jun 23 11:05:20.563054 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 591/1212] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:21.036401 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:21.037820 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:21.046979 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:21.047757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:21.048558 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:21.049294 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:21.079802 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] HTTP exception thrown: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Request method failure captured: Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee HTTP/1.1 Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEcWtCQ4X4W7cx_AuBywqNXx2PWOX0jzEKwstqxWJxEVBwcn-ulcuYECb4LV3Si5NGZ3GB5cjFW9wTsqZECV4dNKeSpJWqOl5XJKG1zFRwSftgSpDSmQ98EV50l0wBpwmeuGyqd-_RsfONXcdmRUWdVC65EUzb1BGMG8wOo8JCpx73A Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:05:21.083373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_737af05e60014fe88e0238e00afb39c6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 845a039c954f4384917100206698d015 Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:21.087296 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'efa3fb90-44b0-44ad-a090-35a851f054ee'} Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:05:21.089168 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:21.092522 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:21.096519 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Returning 404 to user: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:05:21.098097 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-cdd7d6c3-9e89-4496-aef6-6aa467ac9847 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 404 len: 111 microversion: 2.1 time: 0.066037 Jun 23 11:05:21.102361 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 622/1213] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:21 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:05:21.111704 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-37cd615f-c734-4de5-a3c8-f395915a5239 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '.version_select at 0x7f8dc93bb820>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:21.139040 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-37cd615f-c734-4de5-a3c8-f395915a5239 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225849576" status: 202 len: 0 microversion: 2.1 time: 0.032136 Jun 23 11:05:21.141280 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 592/1214] 10.222.0.39 () {58 vars in 1220 bytes} [Thu Jun 23 11:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225849576 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:05:24.381234 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:24.382187 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:24.393363 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:24.393947 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:24.395102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:24.395749 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:24.415767 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] HTTP exception thrown: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Request method failure captured: Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: DELETE /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee HTTP/1.1 Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEcWtCQ4X4W7cx_AuBywqNXx2PWOX0jzEKwstqxWJxEVBwcn-ulcuYECb4LV3Si5NGZ3GB5cjFW9wTsqZECV4dNKeSpJWqOl5XJKG1zFRwSftgSpDSmQ98EV50l0wBpwmeuGyqd-_RsfONXcdmRUWdVC65EUzb1BGMG8wOo8JCpx73A Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:05:24.417346 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_737af05e60014fe88e0238e00afb39c6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 845a039c954f4384917100206698d015 Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.419847 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'efa3fb90-44b0-44ad-a090-35a851f054ee'} Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:05:24.420819 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.422658 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.425314 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Returning 404 to user: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:05:24.425314 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-6e87105e-4255-46e1-8a55-9c2d52ade497 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 404 len: 111 microversion: 2.1 time: 0.044772 Jun 23 11:05:24.425314 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 623/1215] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:05:24 2022] DELETE /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:05:24.430011 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:24.430773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: efa3fb90-44b0-44ad-a090-35a851f054ee] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:24.432751 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:24.439702 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:24.440258 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:24.441062 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:24.441764 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:24.446659 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:24.462099 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] HTTP exception thrown: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Request method failure captured: Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee HTTP/1.1 Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEcWtCQ4X4W7cx_AuBywqNXx2PWOX0jzEKwstqxWJxEVBwcn-ulcuYECb4LV3Si5NGZ3GB5cjFW9wTsqZECV4dNKeSpJWqOl5XJKG1zFRwSftgSpDSmQ98EV50l0wBpwmeuGyqd-_RsfONXcdmRUWdVC65EUzb1BGMG8wOo8JCpx73A Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:05:24.464335 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_737af05e60014fe88e0238e00afb39c6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: 845a039c954f4384917100206698d015 Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.466576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': 'efa3fb90-44b0-44ad-a090-35a851f054ee'} Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:05:24.467730 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. Jun 23 11:05:24.469344 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:24.470956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Returning 404 to user: Instance efa3fb90-44b0-44ad-a090-35a851f054ee could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:05:24.470956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ee99dc8e-e276-4cb4-9459-7b9bb83100da tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee" status: 404 len: 111 microversion: 2.1 time: 0.042043 Jun 23 11:05:24.470956 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 593/1216] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:24 2022] GET /compute/v2.1/servers/efa3fb90-44b0-44ad-a090-35a851f054ee => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:05:25.631349 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:25.632411 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:25.636280 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=21 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:25.645669 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:25.646503 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:25.648282 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:25.649054 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:25.656786 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:25.670113 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.wsgi [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] HTTP exception thrown: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Request method failure captured: Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: request: DELETE /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf HTTP/1.1 Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept: application/json Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Accept-Encoding: identity Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Connection: close Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Length: 0 Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Content-Type: application/json Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Host: 10.222.0.39 Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Openstack-System-Scope: None Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: User-Agent: python-urllib3/1.26.9 Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Auth-Token: gAAAAABitEcWtCQ4X4W7cx_AuBywqNXx2PWOX0jzEKwstqxWJxEVBwcn-ulcuYECb4LV3Si5NGZ3GB5cjFW9wTsqZECV4dNKeSpJWqOl5XJKG1zFRwSftgSpDSmQ98EV50l0wBpwmeuGyqd-_RsfONXcdmRUWdVC65EUzb1BGMG8wOo8JCpx73A Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Id: None Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Domain-Name: None Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Identity-Status: Confirmed Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Is-Admin-Project: True Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Id: default Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Domain-Name: Default Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Project-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Role: reader,member Jun 23 11:05:25.674265 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Roles: reader,member Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_737af05e60014fe88e0238e00afb39c6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Id: default Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Domain-Name: Default Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Id: 845a039c954f4384917100206698d015 Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: X-User-Name: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: method: > Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: exception: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.675978 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: action_args: {'id': 'a600cb79-ea27-4d68-8e08-1245e12ea0cf'} Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:05:25.676885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.679663 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.681218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Returning 404 to user: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. {{(pid=129460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:05:25.681218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f21dd98f-e189-4e44-8898-3390f8111a61 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 404 len: 111 microversion: 2.1 time: 0.049037 Jun 23 11:05:25.681218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 624/1217] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:05:25 2022] DELETE /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:05:25.683243 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:25.684052 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] [instance: a600cb79-ea27-4d68-8e08-1245e12ea0cf] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:25.691515 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:25.692028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:25.692838 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:25.693309 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:25.712302 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] HTTP exception thrown: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Request method failure captured: Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf HTTP/1.1 Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitEcWtCQ4X4W7cx_AuBywqNXx2PWOX0jzEKwstqxWJxEVBwcn-ulcuYECb4LV3Si5NGZ3GB5cjFW9wTsqZECV4dNKeSpJWqOl5XJKG1zFRwSftgSpDSmQ98EV50l0wBpwmeuGyqd-_RsfONXcdmRUWdVC65EUzb1BGMG8wOo8JCpx73A Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:05:25.713855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_737af05e60014fe88e0238e00afb39c6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/737af05e60014fe88e0238e00afb39c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 737af05e60014fe88e0238e00afb39c6 Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691392469 Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: 845a039c954f4384917100206698d015 Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-AttachVolumeTestJSON-691392469-project Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.716169 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': 'a600cb79-ea27-4d68-8e08-1245e12ea0cf'} Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:05:25.717379 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. Jun 23 11:05:25.719634 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:05:25.727655 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] Returning 404 to user: Instance a600cb79-ea27-4d68-8e08-1245e12ea0cf could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:05:25.727655 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-7b28beb8-98cb-4258-9579-fe3dbdc3ec36 tempest-AttachVolumeTestJSON-691392469 tempest-AttachVolumeTestJSON-691392469-project] 10.222.0.39 "GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf" status: 404 len: 111 microversion: 2.1 time: 0.037868 Jun 23 11:05:25.727655 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 594/1218] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:25 2022] GET /compute/v2.1/servers/a600cb79-ea27-4d68-8e08-1245e12ea0cf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:06:54.192984 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:06:54.193620 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Thu Jun 23 11:06:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:07:14.908220 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:15.131472 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-67cb6a45-4ecc-4022-95d3-fe6a1e69ce35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Action: 'create', calling method: .version_select at 0x7f8dc8fc74c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1153079644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfwob3jIzuL9scrogYKzpa8LIrSw7FAbfHh6A3Lc5AthMhNnaua97GXm3lEXKSkk1/+Z+x149XXMCRbty3KfEclmeY/pdOhbtvGFxMR7eae9eVX3jOJTXFDrrmt6QDYiw=="}} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:15.148468 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-67cb6a45-4ecc-4022-95d3-fe6a1e69ce35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Getting quotas for project 8744aa675d3a4bbb8bb2b16a03b9aa61. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:07:15.155313 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.quota [None req-67cb6a45-4ecc-4022-95d3-fe6a1e69ce35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Getting quotas for user b9ad67888a27457b87118583fc6b9a82 and project 8744aa675d3a4bbb8bb2b16a03b9aa61. Resources: {'key_pairs'} {{(pid=129460) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:07:15.185653 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-67cb6a45-4ecc-4022-95d3-fe6a1e69ce35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.286603 Jun 23 11:07:15.186350 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 625/1219] 10.222.0.39 () {60 vars in 1158 bytes} [Thu Jun 23 11:07:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:36.250122 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a71b313c-19cb-46a2-9e4f-0193a38ed475] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 23 11:07:36.256093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1104299777", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1153079644", "security_groups": [{"name": "tempest-secgroup-smoke-1228665758"}], "networks": [{"uuid": "384c8297-d6bd-4e46-b8ce-c1e8d1dd4f4f"}], "block_device_mapping_v2": [{"uuid": "4f1ed8b3-b708-41b9-b4e1-ab0f5bc6b43b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:36.267667 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:36.268270 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:36.401435 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.network.neutron [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] validate_networks() for [('384c8297-d6bd-4e46-b8ce-c1e8d1dd4f4f', None, None, None, None, None)] {{(pid=129461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:07:37.083386 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Flavor limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:07:37.084004 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Image limits 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:07:37.085356 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Flavor pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:07:37.085356 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Image pref 0:0:0 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:07:37.085859 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.virt.hardware [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:07:37.096774 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:37.097221 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:37.098028 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:37.098506 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:37.116472 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Getting quotas for project 8744aa675d3a4bbb8bb2b16a03b9aa61. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:07:37.121945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.quota [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Getting quotas for user b9ad67888a27457b87118583fc6b9a82 and project 8744aa675d3a4bbb8bb2b16a03b9aa61. Resources: {'ram', 'instances', 'cores'} {{(pid=129461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:07:37.192682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Going to run 1 instances... {{(pid=129461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:07:37.194809 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f1ed8b3-b708-41b9-b4e1-ab0f5bc6b43b',volume_size=None,volume_type=None)] {{(pid=129461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:07:37.264252 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [-] [a71b313c-19cb-46a2-9e4f-0193a38ed475] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 54318. Jun 23 11:07:37.358420 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [09463308-52b5-4420-b9a3-3fe69c15a64c] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 11:07:38.362439 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [09463308-52b5-4420-b9a3-3fe69c15a64c] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 54320. Jun 23 11:07:38.366819 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-2152d4e0-89ee-483e-9b0a-25429996c99d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.118666 Jun 23 11:07:38.367815 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 595/1220] 10.222.0.39 () {60 vars in 1146 bytes} [Thu Jun 23 11:07:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:07:38.376334 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: ERROR oslo.messaging._drivers.impl_rabbit [-] [169e09e0-1bdc-4045-adf9-2a2c1601a4a9] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 11:07:38.376334 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:38.378873 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=4 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:38.378873 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:38.383836 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-550cf156-9d1e-4c08-bf8a-a7c4c0e88f98 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:38.384450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-550cf156-9d1e-4c08-bf8a-a7c4c0e88f98 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:38.443779 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-550cf156-9d1e-4c08-bf8a-a7c4c0e88f98 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:38.451717 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-550cf156-9d1e-4c08-bf8a-a7c4c0e88f98 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1089 microversion: 2.1 time: 0.076905 Jun 23 11:07:38.452294 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 626/1221] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:38 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:39.469958 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b48325bb-ca29-4e56-a7a9-ceaef7a0c005 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:39.470867 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b48325bb-ca29-4e56-a7a9-ceaef7a0c005 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:39.532266 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b48325bb-ca29-4e56-a7a9-ceaef7a0c005 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:39.542682 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b48325bb-ca29-4e56-a7a9-ceaef7a0c005 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1089 microversion: 2.1 time: 0.076808 Jun 23 11:07:39.543276 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 596/1222] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:39 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:40.562593 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-bf4fd777-65cf-4906-ab0f-2820a3b3626f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:40.563197 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-bf4fd777-65cf-4906-ab0f-2820a3b3626f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:40.573558 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [-] [169e09e0-1bdc-4045-adf9-2a2c1601a4a9] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 54336. Jun 23 11:07:40.629731 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-bf4fd777-65cf-4906-ab0f-2820a3b3626f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:40.638982 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-bf4fd777-65cf-4906-ab0f-2820a3b3626f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1089 microversion: 2.1 time: 0.081843 Jun 23 11:07:40.639564 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 627/1223] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:40 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:41.656800 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-150447fb-5d8b-4a0f-b17b-3f7100b97264 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:41.657444 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-150447fb-5d8b-4a0f-b17b-3f7100b97264 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:41.720464 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-150447fb-5d8b-4a0f-b17b-3f7100b97264 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:41.729539 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-150447fb-5d8b-4a0f-b17b-3f7100b97264 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1089 microversion: 2.1 time: 0.076777 Jun 23 11:07:41.730127 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 597/1224] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:41 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:42.748007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-c301e146-0e23-4a74-8f99-17e6efbc9288 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:42.748689 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-c301e146-0e23-4a74-8f99-17e6efbc9288 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:42.756739 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c301e146-0e23-4a74-8f99-17e6efbc9288 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.757182 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c301e146-0e23-4a74-8f99-17e6efbc9288 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.757961 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c301e146-0e23-4a74-8f99-17e6efbc9288 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.758947 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-c301e146-0e23-4a74-8f99-17e6efbc9288 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.831204 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-c301e146-0e23-4a74-8f99-17e6efbc9288 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:42.840242 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-c301e146-0e23-4a74-8f99-17e6efbc9288 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1139 microversion: 2.1 time: 0.096108 Jun 23 11:07:42.840820 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 628/1225] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:42 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1139 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:43.858283 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3e5dbdc8-9860-4618-9a80-0c6175d30946 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:43.859006 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3e5dbdc8-9860-4618-9a80-0c6175d30946 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:43.866157 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3e5dbdc8-9860-4618-9a80-0c6175d30946 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.866723 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3e5dbdc8-9860-4618-9a80-0c6175d30946 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.867848 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3e5dbdc8-9860-4618-9a80-0c6175d30946 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.869196 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3e5dbdc8-9860-4618-9a80-0c6175d30946 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.948865 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3e5dbdc8-9860-4618-9a80-0c6175d30946 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:43.963258 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3e5dbdc8-9860-4618-9a80-0c6175d30946 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1205 microversion: 2.1 time: 0.108642 Jun 23 11:07:43.964319 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 598/1226] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:43 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1205 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:44.986277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4509d5b9-1084-4dd3-8fb5-3a148e60ddbf tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:44.987077 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4509d5b9-1084-4dd3-8fb5-3a148e60ddbf tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:44.994495 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4509d5b9-1084-4dd3-8fb5-3a148e60ddbf tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:44.995027 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4509d5b9-1084-4dd3-8fb5-3a148e60ddbf tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:44.996074 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4509d5b9-1084-4dd3-8fb5-3a148e60ddbf tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:44.996577 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4509d5b9-1084-4dd3-8fb5-3a148e60ddbf tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.168842 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4509d5b9-1084-4dd3-8fb5-3a148e60ddbf tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:45.187904 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4509d5b9-1084-4dd3-8fb5-3a148e60ddbf tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.205704 Jun 23 11:07:45.203384 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 629/1227] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:44 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:45.318492 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-e00225a7-6336-430f-a15e-3a3812c00b51 req-835227c6-c453-4029-874d-f97198c9bfcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c23dfb-c4e2-455d-804f-95d215dd080b", "tag": "10cfa370-c031-4594-b8c4-f8e8913e7298"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:45.328558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-e00225a7-6336-430f-a15e-3a3812c00b51 req-835227c6-c453-4029-874d-f97198c9bfcf service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.329430 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-e00225a7-6336-430f-a15e-3a3812c00b51 req-835227c6-c453-4029-874d-f97198c9bfcf service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.345946 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-e00225a7-6336-430f-a15e-3a3812c00b51 req-835227c6-c453-4029-874d-f97198c9bfcf service nova] Creating event network-changed:10cfa370-c031-4594-b8c4-f8e8913e7298 for instance 49c23dfb-c4e2-455d-804f-95d215dd080b on hv-cinder-84614 Jun 23 11:07:45.355416 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-e00225a7-6336-430f-a15e-3a3812c00b51 req-835227c6-c453-4029-874d-f97198c9bfcf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161607 Jun 23 11:07:45.356717 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 599/1228] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:46.211913 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-fe06ca9e-a052-450c-b8e4-4634be53beb8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:46.212454 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-fe06ca9e-a052-450c-b8e4-4634be53beb8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:46.220258 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe06ca9e-a052-450c-b8e4-4634be53beb8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.220708 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe06ca9e-a052-450c-b8e4-4634be53beb8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.221493 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe06ca9e-a052-450c-b8e4-4634be53beb8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.221926 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-fe06ca9e-a052-450c-b8e4-4634be53beb8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.371352 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-fe06ca9e-a052-450c-b8e4-4634be53beb8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:46.378954 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-fe06ca9e-a052-450c-b8e4-4634be53beb8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.171407 Jun 23 11:07:46.379514 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 630/1229] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:46 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:47.398483 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=2 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:47.403145 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b7a3426e-9cd8-47b1-8917-0f045a024b24 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:47.403866 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b7a3426e-9cd8-47b1-8917-0f045a024b24 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:47.410638 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b7a3426e-9cd8-47b1-8917-0f045a024b24 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:47.411084 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b7a3426e-9cd8-47b1-8917-0f045a024b24 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:47.411852 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b7a3426e-9cd8-47b1-8917-0f045a024b24 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:47.412286 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b7a3426e-9cd8-47b1-8917-0f045a024b24 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:47.556250 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b7a3426e-9cd8-47b1-8917-0f045a024b24 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:47.568163 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b7a3426e-9cd8-47b1-8917-0f045a024b24 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.171021 Jun 23 11:07:47.568736 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 600/1230] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:47 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:48.585858 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-2dc6e0fb-001f-4063-b10b-d9f4d885b67d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:48.587043 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-2dc6e0fb-001f-4063-b10b-d9f4d885b67d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:48.593618 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2dc6e0fb-001f-4063-b10b-d9f4d885b67d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.594056 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2dc6e0fb-001f-4063-b10b-d9f4d885b67d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.594842 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2dc6e0fb-001f-4063-b10b-d9f4d885b67d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.595269 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-2dc6e0fb-001f-4063-b10b-d9f4d885b67d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.732614 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-2dc6e0fb-001f-4063-b10b-d9f4d885b67d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:48.740272 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-2dc6e0fb-001f-4063-b10b-d9f4d885b67d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.158469 Jun 23 11:07:48.740833 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 631/1231] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:48 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:49.760512 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ba08f1fd-c96c-4483-a7c4-50780665e7f7 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:49.761395 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ba08f1fd-c96c-4483-a7c4-50780665e7f7 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:49.768106 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ba08f1fd-c96c-4483-a7c4-50780665e7f7 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.768543 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ba08f1fd-c96c-4483-a7c4-50780665e7f7 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.769316 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ba08f1fd-c96c-4483-a7c4-50780665e7f7 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.769745 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ba08f1fd-c96c-4483-a7c4-50780665e7f7 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.946855 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ba08f1fd-c96c-4483-a7c4-50780665e7f7 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:49.957079 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ba08f1fd-c96c-4483-a7c4-50780665e7f7 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.203977 Jun 23 11:07:49.957919 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 601/1232] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:49 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:50.974063 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f6a3a6aa-e158-4eed-8b85-75831b46995f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:50.974690 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f6a3a6aa-e158-4eed-8b85-75831b46995f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:50.978207 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell0:SELECT=4 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:50.986845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6a3a6aa-e158-4eed-8b85-75831b46995f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.987562 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6a3a6aa-e158-4eed-8b85-75831b46995f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:50.988835 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6a3a6aa-e158-4eed-8b85-75831b46995f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.989439 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f6a3a6aa-e158-4eed-8b85-75831b46995f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:51.143898 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f6a3a6aa-e158-4eed-8b85-75831b46995f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:51.151750 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f6a3a6aa-e158-4eed-8b85-75831b46995f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.181479 Jun 23 11:07:51.152327 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 632/1233] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:50 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:52.170370 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fa851589-c155-447d-acbb-7fb03f1f629c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:52.170945 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fa851589-c155-447d-acbb-7fb03f1f629c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:52.173218 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell0:SELECT=10 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:52.179328 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa851589-c155-447d-acbb-7fb03f1f629c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.179773 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa851589-c155-447d-acbb-7fb03f1f629c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.181200 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa851589-c155-447d-acbb-7fb03f1f629c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.181640 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fa851589-c155-447d-acbb-7fb03f1f629c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.323576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-fa851589-c155-447d-acbb-7fb03f1f629c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:52.331643 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fa851589-c155-447d-acbb-7fb03f1f629c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.165514 Jun 23 11:07:52.332207 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 602/1234] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:52 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:53.350224 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-64319b95-b725-4770-b22d-9e0fd6e26a14 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:53.350937 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-64319b95-b725-4770-b22d-9e0fd6e26a14 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:53.358165 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-64319b95-b725-4770-b22d-9e0fd6e26a14 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:53.358646 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-64319b95-b725-4770-b22d-9e0fd6e26a14 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:53.359450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-64319b95-b725-4770-b22d-9e0fd6e26a14 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:53.359880 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-64319b95-b725-4770-b22d-9e0fd6e26a14 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:53.499322 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-64319b95-b725-4770-b22d-9e0fd6e26a14 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:53.507118 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-64319b95-b725-4770-b22d-9e0fd6e26a14 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.160682 Jun 23 11:07:53.507693 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 633/1235] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:53 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:07:54.524833 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-008325d7-0d22-43d2-b2fb-ccc0b20b09f5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:54.526014 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-008325d7-0d22-43d2-b2fb-ccc0b20b09f5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:54.532865 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-008325d7-0d22-43d2-b2fb-ccc0b20b09f5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:54.533305 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-008325d7-0d22-43d2-b2fb-ccc0b20b09f5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:54.534071 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-008325d7-0d22-43d2-b2fb-ccc0b20b09f5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:54.534558 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-008325d7-0d22-43d2-b2fb-ccc0b20b09f5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:54.694780 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-008325d7-0d22-43d2-b2fb-ccc0b20b09f5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:54.702951 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-008325d7-0d22-43d2-b2fb-ccc0b20b09f5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.182500 Jun 23 11:07:54.703527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 603/1236] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:54 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:55.720515 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-4e6954dd-93b0-4799-a58c-8fe2f364bb0f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:55.721142 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-4e6954dd-93b0-4799-a58c-8fe2f364bb0f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:55.727845 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e6954dd-93b0-4799-a58c-8fe2f364bb0f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:55.728289 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e6954dd-93b0-4799-a58c-8fe2f364bb0f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:55.729070 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e6954dd-93b0-4799-a58c-8fe2f364bb0f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:55.729500 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-4e6954dd-93b0-4799-a58c-8fe2f364bb0f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:55.827042 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-fd6d0845-2a4e-4f7f-a14e-cc39d3b9867c req-b0a329b6-93aa-4ab2-a890-ad510aa57b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c23dfb-c4e2-455d-804f-95d215dd080b", "name": "network-vif-plugged", "status": "completed", "tag": "10cfa370-c031-4594-b8c4-f8e8913e7298"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:55.835594 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-fd6d0845-2a4e-4f7f-a14e-cc39d3b9867c req-b0a329b6-93aa-4ab2-a890-ad510aa57b41 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:55.836845 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-fd6d0845-2a4e-4f7f-a14e-cc39d3b9867c req-b0a329b6-93aa-4ab2-a890-ad510aa57b41 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:55.848881 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-fd6d0845-2a4e-4f7f-a14e-cc39d3b9867c req-b0a329b6-93aa-4ab2-a890-ad510aa57b41 service nova] Creating event network-vif-plugged:10cfa370-c031-4594-b8c4-f8e8913e7298 for instance 49c23dfb-c4e2-455d-804f-95d215dd080b on hv-cinder-84614 Jun 23 11:07:55.855471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-fd6d0845-2a4e-4f7f-a14e-cc39d3b9867c req-b0a329b6-93aa-4ab2-a890-ad510aa57b41 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101114 Jun 23 11:07:55.856107 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 604/1237] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:07:55.893227 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-4e6954dd-93b0-4799-a58c-8fe2f364bb0f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:55.901764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-4e6954dd-93b0-4799-a58c-8fe2f364bb0f tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.185308 Jun 23 11:07:55.902368 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 634/1238] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:55 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:56.920407 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-ba49c543-5ed1-4923-942c-ad98b24348d8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:56.921106 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-ba49c543-5ed1-4923-942c-ad98b24348d8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:56.927360 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ba49c543-5ed1-4923-942c-ad98b24348d8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:56.927810 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ba49c543-5ed1-4923-942c-ad98b24348d8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:56.928560 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ba49c543-5ed1-4923-942c-ad98b24348d8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:56.928990 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-ba49c543-5ed1-4923-942c-ad98b24348d8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.062871 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-ba49c543-5ed1-4923-942c-ad98b24348d8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:57.070520 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-ba49c543-5ed1-4923-942c-ad98b24348d8 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1261 microversion: 2.1 time: 0.155353 Jun 23 11:07:57.071668 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 605/1239] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:56 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:58.088764 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-f7f2830d-9b90-4b95-a7a8-dab064de9bd5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:58.089396 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-f7f2830d-9b90-4b95-a7a8-dab064de9bd5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:58.096008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f7f2830d-9b90-4b95-a7a8-dab064de9bd5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.096450 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f7f2830d-9b90-4b95-a7a8-dab064de9bd5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.097205 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f7f2830d-9b90-4b95-a7a8-dab064de9bd5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.097633 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-f7f2830d-9b90-4b95-a7a8-dab064de9bd5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.238541 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-f7f2830d-9b90-4b95-a7a8-dab064de9bd5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:58.247307 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-f7f2830d-9b90-4b95-a7a8-dab064de9bd5 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1444 microversion: 2.1 time: 0.162893 Jun 23 11:07:58.247887 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 635/1240] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:58 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:58.263301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-b5b12b38-e768-42e1-9433-0d3a750bec05 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:58.263914 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-b5b12b38-e768-42e1-9433-0d3a750bec05 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:58.270727 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5b12b38-e768-42e1-9433-0d3a750bec05 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.271163 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5b12b38-e768-42e1-9433-0d3a750bec05 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.271917 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5b12b38-e768-42e1-9433-0d3a750bec05 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.272342 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-b5b12b38-e768-42e1-9433-0d3a750bec05 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.413825 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-b5b12b38-e768-42e1-9433-0d3a750bec05 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:58.422413 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-b5b12b38-e768-42e1-9433-0d3a750bec05 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1444 microversion: 2.1 time: 0.162864 Jun 23 11:07:58.422993 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 606/1241] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:58 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:00.235122 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-c82a2560-0abf-4ca0-b057-a2e3d9c905da req-da1b10aa-b0ce-447a-bb8a-7798f6b4af5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c23dfb-c4e2-455d-804f-95d215dd080b", "tag": "10cfa370-c031-4594-b8c4-f8e8913e7298"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:00.243916 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-c82a2560-0abf-4ca0-b057-a2e3d9c905da req-da1b10aa-b0ce-447a-bb8a-7798f6b4af5f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:00.244355 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-c82a2560-0abf-4ca0-b057-a2e3d9c905da req-da1b10aa-b0ce-447a-bb8a-7798f6b4af5f service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.260095 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-c82a2560-0abf-4ca0-b057-a2e3d9c905da req-da1b10aa-b0ce-447a-bb8a-7798f6b4af5f service nova] Creating event network-changed:10cfa370-c031-4594-b8c4-f8e8913e7298 for instance 49c23dfb-c4e2-455d-804f-95d215dd080b on hv-cinder-84614 Jun 23 11:08:00.265812 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-c82a2560-0abf-4ca0-b057-a2e3d9c905da req-da1b10aa-b0ce-447a-bb8a-7798f6b4af5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118361 Jun 23 11:08:00.266478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 636/1242] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:08:27.356989 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:08:27.357631 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Thu Jun 23 11:08:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:10:09.564627 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:10:09.565277 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Thu Jun 23 11:10:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:10:14.202452 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:10:14.203292 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Thu Jun 23 11:10:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:10:14.218487 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.219226 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=48 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.223878 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-f0505b6a-4876-4681-bac4-3cc1c7f8d42e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:10:14.224527 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-f0505b6a-4876-4681-bac4-3cc1c7f8d42e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:14.232859 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f0505b6a-4876-4681-bac4-3cc1c7f8d42e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:14.233300 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f0505b6a-4876-4681-bac4-3cc1c7f8d42e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:14.234080 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f0505b6a-4876-4681-bac4-3cc1c7f8d42e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:14.234546 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-f0505b6a-4876-4681-bac4-3cc1c7f8d42e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:14.259835 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.objects.instance [None req-f0505b6a-4876-4681-bac4-3cc1c7f8d42e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lazy-loading 'flavor' on Instance uuid 49c23dfb-c4e2-455d-804f-95d215dd080b {{(pid=129461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:10:14.354712 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-f0505b6a-4876-4681-bac4-3cc1c7f8d42e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "POST /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b/action" status: 202 len: 0 microversion: 2.1 time: 0.137712 Jun 23 11:10:14.355300 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 607/1243] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 11:10:14 2022] POST /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:10:14.362037 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=26 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.362827 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=50 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.368381 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7206397a-7b57-4d05-b49b-d924aeab9092 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:14.369102 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7206397a-7b57-4d05-b49b-d924aeab9092 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:14.377712 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7206397a-7b57-4d05-b49b-d924aeab9092 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:14.378166 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7206397a-7b57-4d05-b49b-d924aeab9092 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:14.378974 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7206397a-7b57-4d05-b49b-d924aeab9092 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:14.380001 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7206397a-7b57-4d05-b49b-d924aeab9092 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:14.613664 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7206397a-7b57-4d05-b49b-d924aeab9092 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:14.621882 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7206397a-7b57-4d05-b49b-d924aeab9092 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.261901 Jun 23 11:10:14.622472 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 637/1244] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:14 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:15.640142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-c154a2f7-9840-4e02-905f-7aa13dd7263a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:15.640844 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-c154a2f7-9840-4e02-905f-7aa13dd7263a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:15.649224 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c154a2f7-9840-4e02-905f-7aa13dd7263a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:15.649677 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c154a2f7-9840-4e02-905f-7aa13dd7263a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:15.650500 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c154a2f7-9840-4e02-905f-7aa13dd7263a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:15.650940 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-c154a2f7-9840-4e02-905f-7aa13dd7263a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:15.868816 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-c154a2f7-9840-4e02-905f-7aa13dd7263a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:15.876734 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-c154a2f7-9840-4e02-905f-7aa13dd7263a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.241477 Jun 23 11:10:15.877305 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 608/1245] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:15 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:10:16.896229 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-9834bb66-4573-4280-8599-7aa69fa5514e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:16.896934 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-9834bb66-4573-4280-8599-7aa69fa5514e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:16.904224 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9834bb66-4573-4280-8599-7aa69fa5514e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:16.904670 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9834bb66-4573-4280-8599-7aa69fa5514e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:16.905449 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9834bb66-4573-4280-8599-7aa69fa5514e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:16.905881 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-9834bb66-4573-4280-8599-7aa69fa5514e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:17.062118 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-9834bb66-4573-4280-8599-7aa69fa5514e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:17.070035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-9834bb66-4573-4280-8599-7aa69fa5514e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.179452 Jun 23 11:10:17.070634 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 638/1246] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:16 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:10:18.095234 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-97f2438f-17bb-4a32-9c1e-7b6643864477 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:18.095860 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-97f2438f-17bb-4a32-9c1e-7b6643864477 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:18.102995 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97f2438f-17bb-4a32-9c1e-7b6643864477 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:18.103437 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97f2438f-17bb-4a32-9c1e-7b6643864477 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:18.104192 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97f2438f-17bb-4a32-9c1e-7b6643864477 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:18.104616 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-97f2438f-17bb-4a32-9c1e-7b6643864477 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:18.260952 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-97f2438f-17bb-4a32-9c1e-7b6643864477 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:18.271084 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-97f2438f-17bb-4a32-9c1e-7b6643864477 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.179799 Jun 23 11:10:18.271669 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 609/1247] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:18 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:19.288840 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-606cc002-8f12-4e9a-9fce-0b2624d10d9c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:19.289485 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-606cc002-8f12-4e9a-9fce-0b2624d10d9c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:19.296455 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-606cc002-8f12-4e9a-9fce-0b2624d10d9c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:19.296980 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-606cc002-8f12-4e9a-9fce-0b2624d10d9c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:19.298007 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-606cc002-8f12-4e9a-9fce-0b2624d10d9c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:19.298542 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-606cc002-8f12-4e9a-9fce-0b2624d10d9c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:19.449605 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-606cc002-8f12-4e9a-9fce-0b2624d10d9c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:19.459344 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-606cc002-8f12-4e9a-9fce-0b2624d10d9c tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.173242 Jun 23 11:10:19.459692 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 639/1248] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:19 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:20.477327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-4777acee-c1c9-4adc-931a-9913ff35c56e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:20.477959 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-4777acee-c1c9-4adc-931a-9913ff35c56e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:20.484788 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4777acee-c1c9-4adc-931a-9913ff35c56e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:20.485235 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4777acee-c1c9-4adc-931a-9913ff35c56e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:20.486010 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4777acee-c1c9-4adc-931a-9913ff35c56e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:20.486557 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-4777acee-c1c9-4adc-931a-9913ff35c56e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:20.631696 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-4777acee-c1c9-4adc-931a-9913ff35c56e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:20.639394 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-4777acee-c1c9-4adc-931a-9913ff35c56e tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.166690 Jun 23 11:10:20.639949 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 610/1249] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:20 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:21.657029 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-85652c59-8378-4666-a512-8c424b3a5895 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:21.657649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-85652c59-8378-4666-a512-8c424b3a5895 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:21.664886 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-85652c59-8378-4666-a512-8c424b3a5895 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:21.665076 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-85652c59-8378-4666-a512-8c424b3a5895 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:21.665857 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-85652c59-8378-4666-a512-8c424b3a5895 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:21.666295 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-85652c59-8378-4666-a512-8c424b3a5895 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:21.808090 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-85652c59-8378-4666-a512-8c424b3a5895 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:21.816023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-85652c59-8378-4666-a512-8c424b3a5895 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.162826 Jun 23 11:10:21.816680 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 640/1250] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:21 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:22.834760 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9f52adc2-8009-4be1-93fb-0fdcab4c4037 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:22.835410 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9f52adc2-8009-4be1-93fb-0fdcab4c4037 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:22.842187 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9f52adc2-8009-4be1-93fb-0fdcab4c4037 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:22.842661 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9f52adc2-8009-4be1-93fb-0fdcab4c4037 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:22.843426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9f52adc2-8009-4be1-93fb-0fdcab4c4037 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:22.843860 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9f52adc2-8009-4be1-93fb-0fdcab4c4037 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:22.984894 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9f52adc2-8009-4be1-93fb-0fdcab4c4037 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:22.992832 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9f52adc2-8009-4be1-93fb-0fdcab4c4037 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.163447 Jun 23 11:10:22.993385 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 611/1251] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:22 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:24.011146 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-67051e81-a358-4d0a-a2dd-a01187771528 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:24.011757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-67051e81-a358-4d0a-a2dd-a01187771528 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:24.018494 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-67051e81-a358-4d0a-a2dd-a01187771528 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:24.018938 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-67051e81-a358-4d0a-a2dd-a01187771528 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:24.020223 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-67051e81-a358-4d0a-a2dd-a01187771528 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:24.020656 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-67051e81-a358-4d0a-a2dd-a01187771528 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:24.172645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-67051e81-a358-4d0a-a2dd-a01187771528 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:24.181507 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-67051e81-a358-4d0a-a2dd-a01187771528 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.174673 Jun 23 11:10:24.182096 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 641/1252] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:24 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:25.200093 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-70ebca69-ea25-46c6-9c98-effaa5346bcd tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:25.200746 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-70ebca69-ea25-46c6-9c98-effaa5346bcd tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:25.207716 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-70ebca69-ea25-46c6-9c98-effaa5346bcd tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:25.208158 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-70ebca69-ea25-46c6-9c98-effaa5346bcd tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:25.209203 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-70ebca69-ea25-46c6-9c98-effaa5346bcd tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:25.209635 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-70ebca69-ea25-46c6-9c98-effaa5346bcd tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:25.361480 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-70ebca69-ea25-46c6-9c98-effaa5346bcd tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:25.370471 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-70ebca69-ea25-46c6-9c98-effaa5346bcd tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.173857 Jun 23 11:10:25.371100 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 612/1253] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:25 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:10:26.391788 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-a142e979-f945-4676-a6b5-cea018dd8143 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:26.392447 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-a142e979-f945-4676-a6b5-cea018dd8143 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:26.400140 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a142e979-f945-4676-a6b5-cea018dd8143 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:26.400595 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a142e979-f945-4676-a6b5-cea018dd8143 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:26.401413 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a142e979-f945-4676-a6b5-cea018dd8143 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:26.401885 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-a142e979-f945-4676-a6b5-cea018dd8143 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:26.554427 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-a142e979-f945-4676-a6b5-cea018dd8143 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:26.562104 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-a142e979-f945-4676-a6b5-cea018dd8143 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.174304 Jun 23 11:10:26.562710 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 642/1254] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:26 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:27.580598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-1c21159e-8a89-4f29-a416-4106963785ff tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:27.581196 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-1c21159e-8a89-4f29-a416-4106963785ff tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:27.589087 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1c21159e-8a89-4f29-a416-4106963785ff tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:27.589528 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1c21159e-8a89-4f29-a416-4106963785ff tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:27.590305 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1c21159e-8a89-4f29-a416-4106963785ff tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:27.590764 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-1c21159e-8a89-4f29-a416-4106963785ff tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:27.744330 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-1c21159e-8a89-4f29-a416-4106963785ff tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:27.752499 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-1c21159e-8a89-4f29-a416-4106963785ff tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1510 microversion: 2.1 time: 0.175826 Jun 23 11:10:27.753084 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 613/1255] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:27 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:27.771026 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-e08e904f-c4c1-4db1-8107-8399cbc2b77a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:10:27.771896 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-e08e904f-c4c1-4db1-8107-8399cbc2b77a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:27.778526 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e08e904f-c4c1-4db1-8107-8399cbc2b77a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:27.778970 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e08e904f-c4c1-4db1-8107-8399cbc2b77a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:27.779770 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e08e904f-c4c1-4db1-8107-8399cbc2b77a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:27.780200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-e08e904f-c4c1-4db1-8107-8399cbc2b77a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:27.933298 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-e08e904f-c4c1-4db1-8107-8399cbc2b77a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "POST /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b/action" status: 202 len: 0 microversion: 2.1 time: 0.166931 Jun 23 11:10:27.937775 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 643/1256] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jun 23 11:10:27 2022] POST /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:10:27.947814 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-3cbb8eeb-04bf-4609-8bdf-8359447e0f5a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:27.948933 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-3cbb8eeb-04bf-4609-8bdf-8359447e0f5a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:27.960201 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3cbb8eeb-04bf-4609-8bdf-8359447e0f5a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:27.960981 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3cbb8eeb-04bf-4609-8bdf-8359447e0f5a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:27.962380 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3cbb8eeb-04bf-4609-8bdf-8359447e0f5a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:27.963152 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-3cbb8eeb-04bf-4609-8bdf-8359447e0f5a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:28.134076 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-3cbb8eeb-04bf-4609-8bdf-8359447e0f5a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:28.142292 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-3cbb8eeb-04bf-4609-8bdf-8359447e0f5a tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1518 microversion: 2.1 time: 0.202607 Jun 23 11:10:28.143301 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 614/1257] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:27 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1518 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:29.161597 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-133da63c-8ebb-40ee-b1a6-6a426a03f196 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:29.162200 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-133da63c-8ebb-40ee-b1a6-6a426a03f196 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:29.169684 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-133da63c-8ebb-40ee-b1a6-6a426a03f196 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:29.170126 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-133da63c-8ebb-40ee-b1a6-6a426a03f196 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:29.170917 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-133da63c-8ebb-40ee-b1a6-6a426a03f196 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:29.171354 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-133da63c-8ebb-40ee-b1a6-6a426a03f196 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:29.311649 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-133da63c-8ebb-40ee-b1a6-6a426a03f196 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:29.320072 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-133da63c-8ebb-40ee-b1a6-6a426a03f196 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1520 microversion: 2.1 time: 0.163818 Jun 23 11:10:29.320647 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 644/1258] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:29 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:30.337879 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-d738eb5a-4809-4ca7-9469-f48768abde35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:30.338545 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-d738eb5a-4809-4ca7-9469-f48768abde35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:30.345358 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d738eb5a-4809-4ca7-9469-f48768abde35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:30.345797 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d738eb5a-4809-4ca7-9469-f48768abde35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:30.346581 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d738eb5a-4809-4ca7-9469-f48768abde35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:30.347010 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-d738eb5a-4809-4ca7-9469-f48768abde35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:30.406104 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [req-eb3d4991-2cd6-43ac-aee1-fd5b3d028f42 req-1144667e-702d-4f77-b954-cd38303bfdba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c23dfb-c4e2-455d-804f-95d215dd080b", "name": "network-vif-unplugged", "status": "completed", "tag": "10cfa370-c031-4594-b8c4-f8e8913e7298"}]} {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:10:30.417283 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-eb3d4991-2cd6-43ac-aee1-fd5b3d028f42 req-1144667e-702d-4f77-b954-cd38303bfdba service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:30.417961 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [req-eb3d4991-2cd6-43ac-aee1-fd5b3d028f42 req-1144667e-702d-4f77-b954-cd38303bfdba service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:30.431541 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.compute.server_external_events [req-eb3d4991-2cd6-43ac-aee1-fd5b3d028f42 req-1144667e-702d-4f77-b954-cd38303bfdba service nova] Creating event network-vif-unplugged:10cfa370-c031-4594-b8c4-f8e8913e7298 for instance 49c23dfb-c4e2-455d-804f-95d215dd080b on hv-cinder-84614 Jun 23 11:10:30.437726 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [req-eb3d4991-2cd6-43ac-aee1-fd5b3d028f42 req-1144667e-702d-4f77-b954-cd38303bfdba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036050 Jun 23 11:10:30.438886 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 645/1259] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:10:30.517779 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-d738eb5a-4809-4ca7-9469-f48768abde35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:30.526789 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-d738eb5a-4809-4ca7-9469-f48768abde35 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1576 microversion: 2.1 time: 0.192956 Jun 23 11:10:30.527376 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 615/1260] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:30 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:31.547246 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-d60c6cab-4e2f-4379-b9bc-51fe88315192 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:31.548461 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-d60c6cab-4e2f-4379-b9bc-51fe88315192 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:31.557557 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d60c6cab-4e2f-4379-b9bc-51fe88315192 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:31.558008 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d60c6cab-4e2f-4379-b9bc-51fe88315192 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:31.559186 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d60c6cab-4e2f-4379-b9bc-51fe88315192 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:31.559632 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-d60c6cab-4e2f-4379-b9bc-51fe88315192 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:31.717800 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-d60c6cab-4e2f-4379-b9bc-51fe88315192 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:31.732275 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-d60c6cab-4e2f-4379-b9bc-51fe88315192 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1576 microversion: 2.1 time: 0.191044 Jun 23 11:10:31.732881 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 646/1261] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:31 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:32.755272 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-fbb323c0-bf57-4c51-9c36-0844e03f6e78 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:32.755866 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-fbb323c0-bf57-4c51-9c36-0844e03f6e78 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:32.762964 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fbb323c0-bf57-4c51-9c36-0844e03f6e78 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:32.763421 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fbb323c0-bf57-4c51-9c36-0844e03f6e78 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:32.764212 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fbb323c0-bf57-4c51-9c36-0844e03f6e78 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:32.764664 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-fbb323c0-bf57-4c51-9c36-0844e03f6e78 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:32.919182 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-fbb323c0-bf57-4c51-9c36-0844e03f6e78 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:32.927977 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-fbb323c0-bf57-4c51-9c36-0844e03f6e78 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1576 microversion: 2.1 time: 0.179893 Jun 23 11:10:32.928562 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 616/1262] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:32 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:10:33.948004 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-68b1606b-2a30-4070-9ca5-e9479b3fb7f3 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:33.949152 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-68b1606b-2a30-4070-9ca5-e9479b3fb7f3 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:33.958462 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-68b1606b-2a30-4070-9ca5-e9479b3fb7f3 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:33.959218 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-68b1606b-2a30-4070-9ca5-e9479b3fb7f3 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:33.960435 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-68b1606b-2a30-4070-9ca5-e9479b3fb7f3 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:33.960994 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-68b1606b-2a30-4070-9ca5-e9479b3fb7f3 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:34.112681 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-68b1606b-2a30-4070-9ca5-e9479b3fb7f3 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:34.121814 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-68b1606b-2a30-4070-9ca5-e9479b3fb7f3 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1576 microversion: 2.1 time: 0.179133 Jun 23 11:10:34.122433 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 647/1263] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:33 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:35.139535 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-9e095e4b-033c-4e83-b1b1-257707cc3017 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:35.140118 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-9e095e4b-033c-4e83-b1b1-257707cc3017 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:35.147880 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9e095e4b-033c-4e83-b1b1-257707cc3017 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:35.148324 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9e095e4b-033c-4e83-b1b1-257707cc3017 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:35.149090 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9e095e4b-033c-4e83-b1b1-257707cc3017 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:35.149549 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-9e095e4b-033c-4e83-b1b1-257707cc3017 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:35.284639 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-9e095e4b-033c-4e83-b1b1-257707cc3017 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:35.293263 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-9e095e4b-033c-4e83-b1b1-257707cc3017 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1576 microversion: 2.1 time: 0.157555 Jun 23 11:10:35.293824 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 617/1264] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:35 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:10:36.311642 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-18ed2d54-2a66-4ef5-ba98-d2c76fcfd6a6 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:36.312236 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-18ed2d54-2a66-4ef5-ba98-d2c76fcfd6a6 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:36.319373 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18ed2d54-2a66-4ef5-ba98-d2c76fcfd6a6 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:36.319822 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18ed2d54-2a66-4ef5-ba98-d2c76fcfd6a6 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:36.320601 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18ed2d54-2a66-4ef5-ba98-d2c76fcfd6a6 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:36.321041 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-18ed2d54-2a66-4ef5-ba98-d2c76fcfd6a6 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:36.461673 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-18ed2d54-2a66-4ef5-ba98-d2c76fcfd6a6 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:36.469588 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-18ed2d54-2a66-4ef5-ba98-d2c76fcfd6a6 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1576 microversion: 2.1 time: 0.161824 Jun 23 11:10:36.470173 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 648/1265] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:36 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:10:37.488627 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-84662ce3-a061-4502-bfc3-2002ae4e5744 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:37.489252 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-84662ce3-a061-4502-bfc3-2002ae4e5744 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:37.495365 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-84662ce3-a061-4502-bfc3-2002ae4e5744 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:37.495812 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-84662ce3-a061-4502-bfc3-2002ae4e5744 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:37.496576 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-84662ce3-a061-4502-bfc3-2002ae4e5744 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:37.497014 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-84662ce3-a061-4502-bfc3-2002ae4e5744 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:37.647904 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-84662ce3-a061-4502-bfc3-2002ae4e5744 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:37.655569 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-84662ce3-a061-4502-bfc3-2002ae4e5744 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1576 microversion: 2.1 time: 0.171613 Jun 23 11:10:37.656142 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 618/1266] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:37 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:38.679660 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-b430b799-f9ec-4c6e-ab33-c637e4482f43 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:38.680247 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-b430b799-f9ec-4c6e-ab33-c637e4482f43 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:38.687001 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b430b799-f9ec-4c6e-ab33-c637e4482f43 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:38.687445 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b430b799-f9ec-4c6e-ab33-c637e4482f43 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:38.688214 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b430b799-f9ec-4c6e-ab33-c637e4482f43 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:38.688645 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-b430b799-f9ec-4c6e-ab33-c637e4482f43 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:38.828531 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-b430b799-f9ec-4c6e-ab33-c637e4482f43 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:38.837489 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-b430b799-f9ec-4c6e-ab33-c637e4482f43 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1563 microversion: 2.1 time: 0.163033 Jun 23 11:10:38.838063 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 649/1267] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:38 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:40.494525 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-62e72bfb-eb43-4955-8791-0b9164a47894 req-9f1e5e79-16b6-4019-a069-56b769d817d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c23dfb-c4e2-455d-804f-95d215dd080b", "name": "network-vif-plugged", "status": "completed", "tag": "10cfa370-c031-4594-b8c4-f8e8913e7298"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:10:40.504320 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-62e72bfb-eb43-4955-8791-0b9164a47894 req-9f1e5e79-16b6-4019-a069-56b769d817d0 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:40.504837 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-62e72bfb-eb43-4955-8791-0b9164a47894 req-9f1e5e79-16b6-4019-a069-56b769d817d0 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:40.518448 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-62e72bfb-eb43-4955-8791-0b9164a47894 req-9f1e5e79-16b6-4019-a069-56b769d817d0 service nova] Creating event network-vif-plugged:10cfa370-c031-4594-b8c4-f8e8913e7298 for instance 49c23dfb-c4e2-455d-804f-95d215dd080b on hv-cinder-84614 Jun 23 11:10:40.525788 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-62e72bfb-eb43-4955-8791-0b9164a47894 req-9f1e5e79-16b6-4019-a069-56b769d817d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035209 Jun 23 11:10:40.526622 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 619/1268] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:47.367088 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:11:47.367657 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Thu Jun 23 11:11:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:12:09.101021 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_api:SELECT=28 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:09.102283 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG dbcounter [-] [129460] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:09.105767 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_api:SELECT=26 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:09.106788 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG dbcounter [-] [129461] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:09.107136 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-95965ee7-b041-4784-81a9-5a2f5f8deff4 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:09.108057 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-95965ee7-b041-4784-81a9-5a2f5f8deff4 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:09.111907 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-2250e43e-8fe5-4b54-b22b-6376a5080f47 req-29faa9d7-d667-480f-95ea-502bcff62170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c23dfb-c4e2-455d-804f-95d215dd080b", "tag": "10cfa370-c031-4594-b8c4-f8e8913e7298"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:09.115573 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-95965ee7-b041-4784-81a9-5a2f5f8deff4 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:09.116304 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-95965ee7-b041-4784-81a9-5a2f5f8deff4 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:09.117071 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-95965ee7-b041-4784-81a9-5a2f5f8deff4 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:09.117674 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-95965ee7-b041-4784-81a9-5a2f5f8deff4 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:09.122426 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-2250e43e-8fe5-4b54-b22b-6376a5080f47 req-29faa9d7-d667-480f-95ea-502bcff62170 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:09.122911 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-2250e43e-8fe5-4b54-b22b-6376a5080f47 req-29faa9d7-d667-480f-95ea-502bcff62170 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:09.136731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-2250e43e-8fe5-4b54-b22b-6376a5080f47 req-29faa9d7-d667-480f-95ea-502bcff62170 service nova] Creating event network-changed:10cfa370-c031-4594-b8c4-f8e8913e7298 for instance 49c23dfb-c4e2-455d-804f-95d215dd080b on hv-cinder-84614 Jun 23 11:12:09.142152 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-2250e43e-8fe5-4b54-b22b-6376a5080f47 req-29faa9d7-d667-480f-95ea-502bcff62170 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038474 Jun 23 11:12:09.142985 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 620/1269] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:12:09.145757 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-95965ee7-b041-4784-81a9-5a2f5f8deff4 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Going to try to terminate instance {{(pid=129460) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:12:09.233287 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-95965ee7-b041-4784-81a9-5a2f5f8deff4 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "DELETE /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 204 len: 0 microversion: 2.1 time: 0.133903 Jun 23 11:12:09.234251 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 650/1270] 10.222.0.39 () {58 vars in 1238 bytes} [Thu Jun 23 11:12:09 2022] DELETE /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:12:09.245513 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e69f8152-6e2d-4fcb-861e-14b7d48504b0 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:09.246430 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e69f8152-6e2d-4fcb-861e-14b7d48504b0 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:09.252925 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e69f8152-6e2d-4fcb-861e-14b7d48504b0 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:09.253375 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e69f8152-6e2d-4fcb-861e-14b7d48504b0 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:09.254141 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e69f8152-6e2d-4fcb-861e-14b7d48504b0 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:09.254598 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e69f8152-6e2d-4fcb-861e-14b7d48504b0 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:09.393777 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.policy [None req-e69f8152-6e2d-4fcb-861e-14b7d48504b0 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:09.402803 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e69f8152-6e2d-4fcb-861e-14b7d48504b0 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.163953 Jun 23 11:12:09.403455 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 621/1271] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:09 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:10.421561 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-7fd6624b-fdaa-42c1-9e32-ab0babb81159 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:10.422299 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-7fd6624b-fdaa-42c1-9e32-ab0babb81159 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:10.429575 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7fd6624b-fdaa-42c1-9e32-ab0babb81159 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:10.430023 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7fd6624b-fdaa-42c1-9e32-ab0babb81159 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:10.430813 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7fd6624b-fdaa-42c1-9e32-ab0babb81159 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:10.431247 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-7fd6624b-fdaa-42c1-9e32-ab0babb81159 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:10.571469 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-7fd6624b-fdaa-42c1-9e32-ab0babb81159 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:10.579010 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-7fd6624b-fdaa-42c1-9e32-ab0babb81159 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1569 microversion: 2.1 time: 0.161686 Jun 23 11:12:10.579563 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 651/1272] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:10 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:11.351343 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [req-5b0c9a2e-d5c0-42bc-a5d4-746a62b814c5 req-d7c4f3e6-7c26-4948-a1a8-97fd1f939814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c23dfb-c4e2-455d-804f-95d215dd080b", "name": "network-vif-deleted", "tag": "10cfa370-c031-4594-b8c4-f8e8913e7298"}]} {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:11.360089 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-5b0c9a2e-d5c0-42bc-a5d4-746a62b814c5 req-d7c4f3e6-7c26-4948-a1a8-97fd1f939814 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:11.360859 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [req-5b0c9a2e-d5c0-42bc-a5d4-746a62b814c5 req-d7c4f3e6-7c26-4948-a1a8-97fd1f939814 service nova] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:11.373303 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.compute.server_external_events [req-5b0c9a2e-d5c0-42bc-a5d4-746a62b814c5 req-d7c4f3e6-7c26-4948-a1a8-97fd1f939814 service nova] Creating event network-vif-deleted:10cfa370-c031-4594-b8c4-f8e8913e7298 for instance 49c23dfb-c4e2-455d-804f-95d215dd080b on hv-cinder-84614 Jun 23 11:12:11.378620 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [req-5b0c9a2e-d5c0-42bc-a5d4-746a62b814c5 req-d7c4f3e6-7c26-4948-a1a8-97fd1f939814 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032453 Jun 23 11:12:11.379262 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 622/1273] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:12:11.597186 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-8dfb0436-a635-4c72-8d25-4aa2a7d3632d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:11.597781 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.compute.api [None req-8dfb0436-a635-4c72-8d25-4aa2a7d3632d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129460) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:11.604768 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8dfb0436-a635-4c72-8d25-4aa2a7d3632d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:11.605192 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8dfb0436-a635-4c72-8d25-4aa2a7d3632d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:11.606095 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8dfb0436-a635-4c72-8d25-4aa2a7d3632d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:11.607261 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG oslo_concurrency.lockutils [None req-8dfb0436-a635-4c72-8d25-4aa2a7d3632d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:11.686338 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.policy [None req-8dfb0436-a635-4c72-8d25-4aa2a7d3632d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad67888a27457b87118583fc6b9a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129460) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:11.697294 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-8dfb0436-a635-4c72-8d25-4aa2a7d3632d tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 200 len: 1220 microversion: 2.1 time: 0.103860 Jun 23 11:12:11.698478 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 652/1274] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:11 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:12.722995 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '>' {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:12.723693 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.compute.api [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] [instance: 49c23dfb-c4e2-455d-804f-95d215dd080b] Fetching instance by UUID {{(pid=129461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:12.730606 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:12.731055 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:12.731819 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:12.732256 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG oslo_concurrency.lockutils [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Lock "2fbacf08-c442-40fa-9217-0ac16ded2d58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:12.746348 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.wsgi [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] HTTP exception thrown: Instance 49c23dfb-c4e2-455d-804f-95d215dd080b could not be found. Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Request method failure captured: Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: request: GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b HTTP/1.1 Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept: application/json Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Accept-Encoding: identity Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Connection: close Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Length: 0 Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Content-Type: application/json Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Host: 10.222.0.39 Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Openstack-System-Scope: None Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: User-Agent: python-urllib3/1.26.9 Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Auth-Token: gAAAAABitElcjOGdUpuqCdrTXYAgJU3lm8BgjP6MvMPweZjOBwYvTs0cL6Ad-KW6mrr6P_Xe6Q9NTKK12Jc-L1MMXc-mAwhUgQAJRAXY8JAJ_eG2jZf8qDbYLmefdZUqb2NRPDhVmdF3OB2v-63V7qjEUNCLpIkR_dagpwqzNlVGCb3m9HAxISk Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Id: None Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Domain-Name: None Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Identity-Status: Confirmed Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Is-Admin-Project: True Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Id: default Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Domain-Name: Default Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Id: 8744aa675d3a4bbb8bb2b16a03b9aa61 Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Project-Name: tempest-TestShelveInstance-2008474896 Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Role: reader,member Jun 23 11:12:12.747986 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Roles: reader,member Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8744aa675d3a4bbb8bb2b16a03b9aa61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8744aa675d3a4bbb8bb2b16a03b9aa61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8744aa675d3a4bbb8bb2b16a03b9aa61", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8744aa675d3a4bbb8bb2b16a03b9aa61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant: tempest-TestShelveInstance-2008474896 Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Id: 8744aa675d3a4bbb8bb2b16a03b9aa61 Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-Tenant-Name: tempest-TestShelveInstance-2008474896 Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User: tempest-TestShelveInstance-2008474896-project Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Id: default Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Domain-Name: Default Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Id: b9ad67888a27457b87118583fc6b9a82 Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: X-User-Name: tempest-TestShelveInstance-2008474896-project Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: method: > Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: exception: Instance 49c23dfb-c4e2-455d-804f-95d215dd080b could not be found. Jun 23 11:12:12.750826 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: action_args: {'id': '49c23dfb-c4e2-455d-804f-95d215dd080b'} Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: {{(pid=129461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c23dfb-c4e2-455d-804f-95d215dd080b could not be found. Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:12:12.752327 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c23dfb-c4e2-455d-804f-95d215dd080b could not be found. Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c23dfb-c4e2-455d-804f-95d215dd080b could not be found. Jun 23 11:12:12.754731 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: ERROR nova.api.openstack.wsgi Jun 23 11:12:12.757587 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: DEBUG nova.api.openstack.wsgi [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Returning 404 to user: Instance 49c23dfb-c4e2-455d-804f-95d215dd080b could not be found. {{(pid=129461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:12:12.757587 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO nova.api.openstack.requestlog [None req-e408d2e0-d5a1-4636-88f0-4805ab9aab28 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b" status: 404 len: 111 microversion: 2.1 time: 0.031062 Jun 23 11:12:12.757587 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: [pid: 129461|app: 0|req: 623/1275] 10.222.0.39 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:12 2022] GET /compute/v2.1/servers/49c23dfb-c4e2-455d-804f-95d215dd080b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:12:12.919087 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: DEBUG nova.api.openstack.wsgi [None req-28c05fbd-bed1-4fae-b5e1-402ed0079109 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] Calling method '.version_select at 0x7f8dc8f7da60>' {{(pid=129460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:12.941035 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO nova.api.openstack.requestlog [None req-28c05fbd-bed1-4fae-b5e1-402ed0079109 tempest-TestShelveInstance-2008474896 tempest-TestShelveInstance-2008474896-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1153079644" status: 202 len: 0 microversion: 2.1 time: 0.026529 Jun 23 11:12:12.941810 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: [pid: 129460|app: 0|req: 653/1276] 10.222.0.39 () {58 vars in 1253 bytes} [Thu Jun 23 11:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1153079644 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:13:32.559319 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:13:32.559860 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Thu Jun 23 11:13:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:13:34.213987 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:13:34.214621 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Thu Jun 23 11:13:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:15:07.375346 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:15:07.375984 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Thu Jun 23 11:15:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:15:09.575552 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:15:09.576131 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Thu Jun 23 11:15:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:16:52.568329 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:16:52.568817 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Thu Jun 23 11:16:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:16:54.223246 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:16:54.223881 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Thu Jun 23 11:16:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:17:22.917000 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:17:22.917591 dv-cinder-846146-4-iscsi devstack@n-api.service[129461]: Thu Jun 23 11:17:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:17:25.796917 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:17:25.797513 dv-cinder-846146-4-iscsi devstack@n-api.service[129460]: Thu Jun 23 11:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!